diff --git a/.github/copilot-instructions.md b/.github/copilot-instructions.md new file mode 100644 index 000000000..82e96ff75 --- /dev/null +++ b/.github/copilot-instructions.md @@ -0,0 +1,172 @@ +# GDASApp +## JEDI Configuration Builder - GDAS Client + +JCB-GDAS, contained in the subdirectory `parm/jcb-gdas` of this repository, is a configuration client for the JEDI Configuration Builder (JCB) system used by NOAA-EMC for Global Data Assimilation System (GDAS) weather forecasting and data assimilation. It contains YAML Jinja2 templates for configuring JEDI algorithms, models, and observations. + +Always reference these instructions first and fallback to search or bash commands only when you encounter unexpected information that does not match the info here. + +### Working Effectively + +#### Initial Setup and Dependencies +- Install Python 3.6+ and basic dependencies: + ```bash + python3 -m pip install --user pyyaml jinja2 click pytest + ``` + +#### JCB Development Environment Setup +- Clone and set up the main JCB repository with clients: + ```bash + cd /tmp + git clone --branch develop --recursive https://github.com/NOAA-EMC/jcb.git jcb_repo # Takes 30-60 seconds + cd jcb_repo + ./jcb_client_init.py # Takes 2-3 minutes. NEVER CANCEL. Set timeout to 5+ minutes. + python3 -m pip install --user . # Takes 30-60 seconds + ``` +- The init script clones repositories containing the clients (jcb-gdas, jcb-rdas, etc.) and algorithms into `src/jcb/configuration/` +- **CRITICAL**: Always run from development directory with PYTHONPATH for local testing + +#### Testing and Validation +- Run client integration tests from JCB repo with proper PYTHONPATH: + ```bash + cd /tmp/jcb_repo + PYTHONPATH=/tmp/jcb_repo/src pytest test/client_integration -v + ``` + - Takes 15-20 seconds to complete. NEVER CANCEL. + - Some tests may fail on .git directory checks - this is normal + - Set timeout to 60+ seconds for safety + +#### Rendering JEDI Configurations +- Test configuration rendering using Python API: + ```bash + cd /tmp/jcb_repo + PYTHONPATH=/tmp/jcb_repo/src python3 -c " + import jcb + import yaml + config = yaml.safe_load(open('/path/to/gdas/templates.yaml')) + result = jcb.render(config) + print('Render successful') + " + ``` +- The command-line interface requires development setup: + ```bash + cd /tmp/jcb_repo + PYTHONPATH=/tmp/jcb_repo/src python3 -m jcb.driver render input.yaml output.yaml + ``` + +### Validation + +#### Manual Validation Steps +- ALWAYS test configuration rendering after making changes to templates +- Run client integration tests to ensure templates are properly structured +- Validate YAML syntax for non-template files (.yaml): + ```bash + python3 -c "import yaml; yaml.safe_load(open('file.yaml'))" + ``` +- For template files (.yaml.j2), use JCB rendering to validate: + ```bash + cd /tmp/jcb_repo + PYTHONPATH=/tmp/jcb_repo/src python3 -c "import jcb, yaml; config=yaml.safe_load(open('template_dict.yaml')); jcb.render(config)" + ``` +- Check template variable consistency across related files + +#### GitHub Workflow Validation +- The JCB-GDAS client uses GitHub Actions for CI testing at `.github/workflows/run_jcb_basic_testing.yaml` +- Workflow clones main JCB repo, initializes clients, and runs integration tests +- Takes 3-5 minutes total. NEVER CANCEL. +- Set timeout to 10+ minutes for workflow commands + +### Client Structure + +#### Key Directories +- `algorithm/` - Data assimilation algorithm templates (3dvar, LETKF, etc.) + - `atmosphere/` - Atmospheric DA algorithm configurations + - `marine/`, `aero/`, `snow/` - Other domain-specific algorithms +- `model/` - Model configuration templates + - `atmosphere/` - FV3-JEDI atmospheric model configs + - Contains Jinja2 templates (.j2) for geometry, backgrounds, increments +- `observations/` - Observation operator templates + - `atmosphere/` - Satellite and conventional observation configs + - Individual files for each instrument/platform (e.g., abi_g17.yaml.j2) +- `observation_chronicle/` - Observation metadata and channel configurations +- `test/client_integration/` - Integration test templates and configurations + +#### File Naming Conventions +- All template files use `.yaml.j2` extension for Jinja2 templates +- Model templates must use `_` prefix (e.g., `atmosphere_background.yaml.j2`) +- Observation files named by instrument/platform (e.g., `iasi_metop-a.yaml.j2`) + +#### Template Variables +- Variables follow naming pattern: `_` +- Example: `atmosphere_background_path`, `marine_model_timestep` +- Template files in model/ directory MUST use component-prefixed variables + +### Common Tasks + +#### Client Directory Structure (for reference) +``` +/home/runner/work/jcb-gdas/jcb-gdas/ +├── .github/workflows/run_jcb_basic_testing.yaml # CI workflow +├── algorithm/ +│ ├── aero/, atmosphere/, marine/, obstats/, snow/ +│ └── atmosphere/fv3jedi_fv3inc_lgetkf.yaml.j2 # Example algorithm +├── model/ +│ ├── aero/, atmosphere/, marine/, snow/ +│ └── atmosphere/atmosphere_background.yaml.j2 # Example model config +├── observations/ +│ ├── aero/, atmosphere/, atmosphere-lgetkf/, marine/, snow/ +│ └── atmosphere/iasi_metop-a.yaml.j2 # Example observation +├── observation_chronicle/ +│ ├── atmosphere/, snow/ +│ └── atmosphere/abi_g17.yaml # Example chronicle metadata +└── test/client_integration/ + ├── gdas-atmosphere-templates.yaml # Test template dictionary + └── gdas-marine-templates.yaml +``` + +#### Working with Templates +- Edit `.yaml.j2` files using standard text editors +- Variables use Jinja2 syntax: `{{ variable_name }}` +- Test rendering with sample template dictionaries from `test/client_integration/` +- Always validate template syntax before committing + +#### Adding New Observations +- Create new `.yaml.j2` file in appropriate `observations//` directory +- Follow existing naming patterns (instrument_platform.yaml.j2) +- Add corresponding metadata file in `observation_chronicle/` if needed +- Test rendering with existing template configurations + +#### Debugging Template Issues +- Check variable naming consistency across files +- Validate YAML structure after template rendering +- Use Python API for debugging: `jcb.render(template_dict)` returns rendered config +- Review client integration test output for template validation errors + +### Important Notes + +- **NEVER CANCEL** GitHub workflow runs - they may take 5+ minutes +- **NEVER CANCEL** client initialization - takes 2-3 minutes for git clones +- **NEVER CANCEL** integration tests - they may take 15-30 seconds but can appear to hang +- This is a configuration client - no compilation/build process required +- Changes affect JEDI experiment configurations used in weather forecasting +- Template changes require integration testing with main JCB system +- Use development JCB setup for local testing and validation + +### Troubleshooting + +#### Common Issues +- **"FileNotFoundError: configuration/apps"** - Run JCB from development directory with PYTHONPATH +- **"Template key does not start with component_"** - Ensure model templates use proper prefixed variables +- **"YAML scanner error in .j2 file"** - Don't validate .j2 templates with yaml.safe_load, use JCB rendering +- **Integration tests fail on .git directory** - This is normal, test still validates templates + +#### Performance Notes +- JCB client initialization: 2-3 minutes (git clones) +- Client integration tests: 15-30 seconds +- Configuration rendering: 1-5 seconds per template +- GitHub workflow: 3-5 minutes total + +#### Expected File Counts +- Algorithm templates: ~10 files per component +- Model templates: ~15 files per component +- Observation templates: ~50+ files in atmosphere/ (satellites, instruments) +- Observation chronicles: ~50+ metadata files diff --git a/.github/workflows/run_jcb_basic_testing.yaml b/.github/workflows/run_jcb_basic_testing.yaml new file mode 100644 index 000000000..d8d4b1295 --- /dev/null +++ b/.github/workflows/run_jcb_basic_testing.yaml @@ -0,0 +1,121 @@ +name: Run JCB client testing with client changes + +on: + push: + branches: + - develop + pull_request: + types: + - opened + - synchronize + - reopened + +jobs: + + jcb_integration_tests: + + runs-on: ubuntu-latest + name: JCB Client Integration Tests + + env: + JCB_REPO: https://github.com/NOAA-EMC/jcb.git + + steps: + - name: Set up Python + uses: actions/setup-python@v4 + with: + python-version: '3.x' + + - name: Add repo url to the environment + run: | + JCB_APP_REPO="${{ github.repository }}" + echo "JCB_APP_REPO=${JCB_APP_REPO}" >> $GITHUB_ENV + + - name: Determine the name of the client branch + run: | + if [ "${{ github.event_name }}" == "pull_request" ]; then + JCB_APP_BRANCH=${{ github.head_ref }} + else + BRANCH_REF=${{ github.ref }} + JCB_APP_BRANCH=${BRANCH_REF#refs/heads/} + fi + echo "JCB_APP_BRANCH=$JCB_APP_BRANCH" >> $GITHUB_ENV + + - name: Determine branch to use for main jcb repo + run: | + BRANCH_NAME=${{ env.JCB_APP_BRANCH }} + if git ls-remote --heads $JCB_REPO $BRANCH_NAME | grep -q "refs/heads/$BRANCH_NAME"; then + echo "Branch $BRANCH_NAME exists in jcb repo." + echo "JCB_BRANCH=$BRANCH_NAME" >> $GITHUB_ENV + else + echo "Branch $BRANCH_NAME does not exist in jcb repo. Using develop branch." + echo "JCB_BRANCH=develop" >> $GITHUB_ENV + fi + + - name: Check for the branch name in the jcb-algorithms repo (if not develop) + run: | + BRANCH_NAME=${{ env.JCB_APP_BRANCH }} + + # If branch name is develop then we don't need to check the jcb-algorithms repo. + if [ "$BRANCH_NAME" == "develop" ]; then + echo "JCB_ALGO_BRANCH=develop" >> $GITHUB_ENV + exit 0 + fi + + # If the branch is not develop then check the jcb-algorithms repo. + if git ls-remote --heads https://github.com/NOAA-EMC/jcb-algorithms.git $BRANCH_NAME | grep -q "refs/heads/$BRANCH_NAME"; then + echo "Branch $BRANCH_NAME exists in jcb-algorithms repo." + echo "JCB_ALGO_BRANCH=$BRANCH_NAME" >> $GITHUB_ENV + + # If the branch exists in jcb-algorithms repo but JCB_BRANCH is develop then we need to + # throw an error. This is not a safe situation. The developer should create a branch in + # the main jcb repo with the same name as the branch in the jcb-application repo. + # If there were branches in other apps to account for the changes in the algorithm repo + # they could not be tested here since the scipt is not clever enough to check for + # the existence of the branch being tested here in all the clients. The safest thing to do + # is simply create a branch with the same name (even if empty) in the main jcb repo. This + # will ensure the branches of the other applications are checked out by the init script. + + if [ "${{ env.JCB_BRANCH }}" == "develop" ]; then + echo "Branch $BRANCH_NAME exists in jcb-algorithms repo but not in the main jcb repo. " + echo "Please create a branch with the same name (even if empty with no PR) in the main " + echo "jcb repo. This ensures safely checking all the clients that depend on the " + echo "jcb and jcb-algorithms repos with the changes being proposed." + exit 1 + fi + fi + + - name: Clone jcb repository + run: | + mkdir -p empty_hooks + git config --global core.hooksPath empty_hooks + git clone --branch ${{ env.JCB_BRANCH }} --recursive $JCB_REPO jcb_repo + + - name: Create custom jcb_clients.yaml for isolated testing + run: | + cd jcb_repo + + # Create a custom jcb_clients.yaml that only includes the current repository + cat > jcb_clients.yaml << EOF + gdas: + git_url: noaa-emc/gdasapp + #git_ref: develop + git_ref: feature/jcb-gdas + app_subdir: parm/jcb-gdas + EOF + + - name: Clone the clients + run: | + cd jcb_repo + pip install pyyaml + ./jcb_client_init.py + + - name: Install dependencies + run: | + cd jcb_repo + pip install .[testing] + + - name: Run the JCB client integration tests + run: | + cd jcb_repo/test/client_integration + pytest -v diff --git a/.gitmodules b/.gitmodules index 6ca2dbc18..4319b5d63 100644 --- a/.gitmodules +++ b/.gitmodules @@ -53,10 +53,6 @@ path = sorc/jcb url = https://github.com/noaa-emc/jcb.git branch = develop -[submodule "parm/jcb-gdas"] - path = parm/jcb-gdas - url = https://github.com/noaa-emc/jcb-gdas - branch = develop [submodule "parm/jcb-algorithms"] path = parm/jcb-algorithms url = https://github.com/noaa-emc/jcb-algorithms diff --git a/parm/jcb-gdas b/parm/jcb-gdas deleted file mode 160000 index 5891b215d..000000000 --- a/parm/jcb-gdas +++ /dev/null @@ -1 +0,0 @@ -Subproject commit 5891b215d82ffae1cb27aa203c6161dcc523b541 diff --git a/parm/jcb-gdas/algorithm/aero/aero_addincrement.yaml.j2 b/parm/jcb-gdas/algorithm/aero/aero_addincrement.yaml.j2 new file mode 100644 index 000000000..895995ee4 --- /dev/null +++ b/parm/jcb-gdas/algorithm/aero/aero_addincrement.yaml.j2 @@ -0,0 +1,43 @@ +state geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_ges }} + npy: {{ aero_npy_ges }} + npz: {{ aero_npz_ges }} + field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_history.yaml +increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_ges }} + npy: {{ aero_npy_ges }} + npz: {{ aero_npz_ges }} + field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_restart.yaml +state: + datetime: '{{ aero_background_time_iso }}' + state variables: {{ analysis_variables }} + filetype: cube sphere history + provider: ufs + datapath: ./ + filename: {{ aero_variational_history_prefix }}cubed_sphere_grid_atmf006.nc +increment: + added variables: {{ analysis_variables }} + filetype: fms restart + datapath: ./ + filename is datetime templated: true + filename_trcr: '%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc' + prefix: aeroinc +output: + filetype: auxgrid + gridtype: gaussian + datapath: ./ + filename: aeroanl. diff --git a/parm/jcb-gdas/algorithm/aero/aero_convert_background.yaml.j2 b/parm/jcb-gdas/algorithm/aero/aero_convert_background.yaml.j2 new file mode 100644 index 000000000..7b4d38c0e --- /dev/null +++ b/parm/jcb-gdas/algorithm/aero/aero_convert_background.yaml.j2 @@ -0,0 +1,84 @@ +input geometry: + fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" + akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_ges }} + npy: {{ aero_npy_ges }} + npz: {{ aero_npz_ges }} +output geometry: + fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" + akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_anl }} + npy: {{ aero_npy_anl }} + npz: {{ aero_npz_anl }} +states: +- input: + datetime: '{{ aero_background_error_time_iso }}' + filetype: fms restart + state variables: + - mass_fraction_of_sulfate_in_air + - mass_fraction_of_hydrophobic_black_carbon_in_air + - mass_fraction_of_hydrophilic_black_carbon_in_air + - mass_fraction_of_hydrophobic_organic_carbon_in_air + - mass_fraction_of_hydrophilic_organic_carbon_in_air + - mass_fraction_of_dust001_in_air + - mass_fraction_of_dust002_in_air + - mass_fraction_of_dust003_in_air + - mass_fraction_of_dust004_in_air + - mass_fraction_of_dust005_in_air + - mass_fraction_of_sea_salt001_in_air + - mass_fraction_of_sea_salt002_in_air + - mass_fraction_of_sea_salt003_in_air + - mass_fraction_of_sea_salt004_in_air + - mass_fraction_of_sea_salt005_in_air + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas1 + mass_fraction_of_sea_salt002_in_air: seas2 + mass_fraction_of_sea_salt003_in_air: seas3 + mass_fraction_of_sea_salt004_in_air: seas4 + mass_fraction_of_sea_salt005_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 + datapath: {{ aero_background_path }} + filename_core: '{{ aero_background_error_time_fv3 }}.fv_core.res.nc' + filename_trcr: '{{ aero_background_error_time_fv3 }}.fv_tracer.res.nc' + filename_cplr: '{{ aero_background_error_time_fv3 }}.coupler.res' + output: + filetype: fms restart + datapath: {{ aero_background_path }} + filename_core: 'anlres.fv_core.res.nc' + filename_trcr: 'anlres.fv_tracer.res.nc' + filename_cplr: 'anlres.coupler.res' + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas1 + mass_fraction_of_sea_salt002_in_air: seas2 + mass_fraction_of_sea_salt003_in_air: seas3 + mass_fraction_of_sea_salt004_in_air: seas4 + mass_fraction_of_sea_salt005_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 diff --git a/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_diagb.yaml.j2 b/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_diagb.yaml.j2 new file mode 100644 index 000000000..62e88a91a --- /dev/null +++ b/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_diagb.yaml.j2 @@ -0,0 +1,147 @@ +geometry: + fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" + akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_anl }} + npy: {{ aero_npy_anl }} + npz: {{ aero_npz_anl }} + time invariant fields: + state fields: + datetime: '{{ aero_background_error_time_iso }}' + filetype: fms restart + skip coupler file: true + state variables: + - slmsk + field io names: + slmsk: slmsk + datapath: {{ aero_background_path }}/ + filename_orog: {{ aero_orog_prefix }}_oro_data.nc + filename_sfcd: {{ aero_background_error_time_fv3 }}.sfc_data.nc +date: '{{ aero_background_error_time_iso }}' +background: + datetime: '{{ aero_background_error_time_iso }}' + filetype: fms restart + state variables: + - mass_fraction_of_sulfate_in_air + - mass_fraction_of_hydrophobic_black_carbon_in_air + - mass_fraction_of_hydrophilic_black_carbon_in_air + - mass_fraction_of_hydrophobic_organic_carbon_in_air + - mass_fraction_of_hydrophilic_organic_carbon_in_air + - mass_fraction_of_dust001_in_air + - mass_fraction_of_dust002_in_air + - mass_fraction_of_dust003_in_air + - mass_fraction_of_dust004_in_air + - mass_fraction_of_dust005_in_air + - mass_fraction_of_sea_salt001_in_air + - mass_fraction_of_sea_salt002_in_air + - mass_fraction_of_sea_salt003_in_air + - mass_fraction_of_sea_salt004_in_air + - mass_fraction_of_sea_salt005_in_air + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas1 + mass_fraction_of_sea_salt002_in_air: seas2 + mass_fraction_of_sea_salt003_in_air: seas3 + mass_fraction_of_sea_salt004_in_air: seas4 + mass_fraction_of_sea_salt005_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 + datapath: {{ aero_background_path }} + filename_core: '{{ aero_background_error_time_fv3 }}.anlres.fv_core.res.nc' + filename_trcr: '{{ aero_background_error_time_fv3 }}.anlres.fv_tracer.res.nc' + filename_cplr: '{{ aero_background_error_time_fv3 }}.anlres.coupler.res' +background error: + filetype: fms restart + datapath: {{ aero_standard_deviation_path }} + filename_trcr: stddev.fv_tracer.res.nc + filename_cplr: stddev.coupler.res + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas1 + mass_fraction_of_sea_salt002_in_air: seas2 + mass_fraction_of_sea_salt003_in_air: seas3 + mass_fraction_of_sea_salt004_in_air: seas4 + mass_fraction_of_sea_salt005_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 +climate background error: + geometry: + fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" + akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_clim_b }} + npy: {{ aero_npy_clim_b }} + npz: {{ aero_npz_clim_b }} + climate background error stddev: + filetype: fms restart + skip coupler file: true + datapath: {{ aero_climatological_b_path }} + filename_trcr: stddev.fv_tracer.res.nc + filename_cplr: stddev.coupler.res + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas1 + mass_fraction_of_sea_salt002_in_air: seas2 + mass_fraction_of_sea_salt003_in_air: seas3 + mass_fraction_of_sea_salt004_in_air: seas4 + mass_fraction_of_sea_salt005_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 + diagb weight: {{ aero_diagb_weight }} + staticb rescaling factor: {{ aero_diagb_static_rescale_factor }} + +variables: + name: + - mass_fraction_of_sulfate_in_air + - mass_fraction_of_hydrophobic_black_carbon_in_air + - mass_fraction_of_hydrophilic_black_carbon_in_air + - mass_fraction_of_hydrophobic_organic_carbon_in_air + - mass_fraction_of_hydrophilic_organic_carbon_in_air + - mass_fraction_of_dust001_in_air + - mass_fraction_of_dust002_in_air + - mass_fraction_of_dust003_in_air + - mass_fraction_of_dust004_in_air + - mass_fraction_of_dust005_in_air + - mass_fraction_of_sea_salt001_in_air + - mass_fraction_of_sea_salt002_in_air + - mass_fraction_of_sea_salt003_in_air + - mass_fraction_of_sea_salt004_in_air + - mass_fraction_of_sea_salt005_in_air + +{% set rescaling_factor_file = aero_rescaling_factor_file|default(aero_gen_bmatrix_rescale_default) %} +{% include rescaling_factor_file %} + +number of halo points: {{ aero_diagb_n_halo }} +number of neighbors: {{ aero_diagb_n_neighbors }} +simple smoothing: + horizontal iterations: {{ aero_diagb_smooth_horiz_iter }} + vertical iterations: {{ aero_diagb_smooth_vert_iter }} diff --git a/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_diffusion.yaml.j2 b/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_diffusion.yaml.j2 new file mode 100644 index 000000000..d1eaa28e2 --- /dev/null +++ b/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_diffusion.yaml.j2 @@ -0,0 +1,69 @@ +geometry: + fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" + akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{ aero_layout_x }} + - {{ aero_layout_y }} + npx: {{ aero_npx_anl }} + npy: {{ aero_npy_anl }} + npz: {{ aero_npz_anl }} +date: '{{ aero_background_error_time_iso }}' +background: + datetime: '{{ aero_background_error_time_iso }}' + filetype: fms restart + state variables: + - mass_fraction_of_sulfate_in_air + - mass_fraction_of_hydrophobic_black_carbon_in_air + - mass_fraction_of_hydrophilic_black_carbon_in_air + - mass_fraction_of_hydrophobic_organic_carbon_in_air + - mass_fraction_of_hydrophilic_organic_carbon_in_air + - mass_fraction_of_dust001_in_air + - mass_fraction_of_dust002_in_air + - mass_fraction_of_dust003_in_air + - mass_fraction_of_dust004_in_air + - mass_fraction_of_dust005_in_air + - mass_fraction_of_sea_salt001_in_air + - mass_fraction_of_sea_salt002_in_air + - mass_fraction_of_sea_salt003_in_air + - mass_fraction_of_sea_salt004_in_air + - mass_fraction_of_sea_salt005_in_air + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas1 + mass_fraction_of_sea_salt002_in_air: seas2 + mass_fraction_of_sea_salt003_in_air: seas3 + mass_fraction_of_sea_salt004_in_air: seas4 + mass_fraction_of_sea_salt005_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 + datapath: {{ aero_background_path }} + filename_core: '{{ aero_background_error_time_fv3 }}.anlres.fv_core.res.nc' + filename_trcr: '{{ aero_background_error_time_fv3 }}.anlres.fv_tracer.res.nc' + filename_cplr: '{{ aero_background_error_time_fv3 }}.anlres.coupler.res' +background error: + covariance model: SABER + saber central block: + saber block name: diffusion + calibration: + normalization: + iterations: {{ aero_diffusion_iter }} + groups: + - horizontal: + fixed value: {{ aero_diffusion_horiz_len }} + write: + filepath: "{{ aero_berror_diffusion_directory }}/diffusion_hz" + - vertical: + levels: {{ aero_npz_ges }} + fixed value: {{ aero_diffusion_fixed_val }} + as gaussian: true + write: + filepath: "{{ aero_berror_diffusion_directory }}/diffusion_vt" diff --git a/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_rescale_default.yaml.j2 b/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_rescale_default.yaml.j2 new file mode 100644 index 000000000..55d14aebf --- /dev/null +++ b/parm/jcb-gdas/algorithm/aero/aero_gen_bmatrix_rescale_default.yaml.j2 @@ -0,0 +1,40 @@ +rescaling factors: + mass_fraction_of_sulfate_in_air: + rescaling factor: 0.1 + mass_fraction_of_hydrophobic_black_carbon_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_hydrophilic_black_carbon_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_hydrophobic_organic_carbon_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_hydrophilic_organic_carbon_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_sea_salt001_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_sea_salt002_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_sea_salt003_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_sea_salt004_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_sea_salt005_in_air: + ocean rescaling factor: 1.0 + land rescaling factor: 1.0 + mass_fraction_of_dust001_in_air: + rescaling factor: 1.0 + mass_fraction_of_dust002_in_air: + rescaling factor: 1.0 + mass_fraction_of_dust003_in_air: + rescaling factor: 1.0 + mass_fraction_of_dust004_in_air: + rescaling factor: 1.0 + mass_fraction_of_dust005_in_air: + rescaling factor: 1.0 diff --git a/parm/jcb-gdas/algorithm/atmosphere/atm_addincrement.yaml.j2 b/parm/jcb-gdas/algorithm/atmosphere/atm_addincrement.yaml.j2 new file mode 100644 index 000000000..b11b3bdfc --- /dev/null +++ b/parm/jcb-gdas/algorithm/atmosphere/atm_addincrement.yaml.j2 @@ -0,0 +1,103 @@ +state geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_ges }} + npy: {{ atmosphere_npy_ges }} + npz: {{ atmosphere_npz_ges }} + field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_history.yaml +increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_anl }} + npy: {{ atmosphere_npy_anl }} + npz: {{ atmosphere_npz_anl }} + field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_fv3inc.yaml +state: + datetime: '{{ atmosphere_background_time_iso }}' + state variables: + - eastward_wind + - northward_wind + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - air_pressure_thickness + - layer_thickness + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr + air_pressure_thickness: dpres + layer_thickness: delz + filetype: cube sphere history + provider: ufs + filename: {{ atmosphere_variational_history_prefix }}cubed_sphere_grid_atmf006.nc + datapath: ./ + max allowable geometry difference: 1e-4 +increment: + added variables: + - eastward_wind + - northward_wind + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - air_pressure_thickness + - layer_thickness + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_ice: icmr_inc + cloud_liquid_water: liq_wat_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + ozone_mass_mixing_ratio: o3mr_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc + filetype: fms restart + is restart: false + filename_nonrestart: {{ atmosphere_variational_analysis_prefix }}cubed_sphere_grid_atminc.nc + datapath: ./ +output: + filetype: auxgrid + gridtype: gaussian + filename: atmanl. + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr + air_pressure_thickness: dpres + layer_thickness: delz diff --git a/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_correction_increment.yaml.j2 b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_correction_increment.yaml.j2 new file mode 100644 index 000000000..170392af0 --- /dev/null +++ b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_correction_increment.yaml.j2 @@ -0,0 +1,121 @@ +increment variables: +- cloud_liquid_water +- layer_thickness +- air_pressure_thickness +- cloud_liquid_ice +- snow_water +- rain_water +- graupel +- ozone_mass_mixing_ratio +- water_vapor_mixing_ratio_wrt_moist_air +- air_temperature +- eastward_wind +- northward_wind +deterministic background geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_ges }} + npy: {{ atmosphere_npy_ges }} + npz: {{ atmosphere_npz_ges }} +variational increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_anl }} + npy: {{ atmosphere_npy_anl }} + npz: {{ atmosphere_npz_anl }} +ensemble mean analysis geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_anl }} + npy: {{ atmosphere_npy_anl }} + npz: {{ atmosphere_npz_anl }} +correction increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_anl }} + npy: {{ atmosphere_npy_anl }} + npz: {{ atmosphere_npz_anl }} +forecast hours: +{% for ihour in range( atmosphere_iau_hours | length ) %} +- datetime: '{{ atmosphere_iau_times_iso[ihour] }}' + deterministic background: + filetype: cube sphere history + provider: ufs + datapath: ./ + filename: {{ atmosphere_variational_history_prefix }}cubed_sphere_grid_atmf{{ '%03d' % atmosphere_iau_hours[ihour] }}.nc + max allowable geometry difference: 1e-04 + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr + air_pressure_thickness: dpres + layer_thickness: delz + variational increment: + filetype: fms restart + is restart: false + datapath: ./ + filename_nonrestart: {{ atmosphere_variational_analysis_prefix }}cubed_sphere_grid_atmi{{ '%03d' % atmosphere_iau_hours[ihour] }}.nc + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_ice: icmr_inc + cloud_liquid_water: liq_wat_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + ozone_mass_mixing_ratio: o3mr_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc + ensemble mean analysis: + filetype: cube sphere history + provider: ufs + datapath: ./ + filename: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_atma{{ '%03d' % atmosphere_iau_hours[ihour] }}.ensmean.nc + correction increment: + filetype: cube sphere history + provider: ufs + datapath: ./ + filename: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_catmi{{ '%03d' % atmosphere_iau_hours[ihour] }}.nc + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_ice: icmr_inc + cloud_liquid_water: liq_wat_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + ozone_mass_mixing_ratio: o3mr_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc +{% endfor %} diff --git a/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_ensemble_recenter.yaml.j2 b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_ensemble_recenter.yaml.j2 new file mode 100644 index 000000000..f71b855ad --- /dev/null +++ b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_ensemble_recenter.yaml.j2 @@ -0,0 +1,109 @@ +members: +{% for imember in range(atmosphere_number_ensemble_members) %} +{% for ihour in range( atmosphere_iau_hours | length ) %} +- state geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_anl }} + npy: {{ atmosphere_npy_anl }} + npz: {{ atmosphere_npz_anl }} + increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_anl }} + npy: {{ atmosphere_npy_anl }} + npz: {{ atmosphere_npz_anl }} + state: + datetime: '{{ atmosphere_iau_times_iso[ihour] }}' + state variables: + - eastward_wind + - northward_wind + - air_temperature + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - air_pressure_thickness + - layer_thickness + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_ice: icmr_inc + cloud_liquid_water: liq_wat_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + ozone_mass_mixing_ratio: o3mr_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc + filetype: cube sphere history + provider: ufs + datapath: ./ + filename: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_catmi{{ '%03d' % atmosphere_iau_hours[ihour] }}.nc + max allowable geometry difference: 1e-4 + increment: + added variables: + - eastward_wind + - northward_wind + - air_temperature + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - air_pressure_thickness + - layer_thickness + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_ice: icmr_inc + cloud_liquid_water: liq_wat_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + ozone_mass_mixing_ratio: o3mr_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc + filetype: cube sphere history + provider: ufs + datapath: ./mem{{ '%0{}d'.format(3)|format(imember+1) }} + filename: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_atmi{{ '%03d' % atmosphere_iau_hours[ihour] }}.nc + output: + filetype: fms restart + is restart: false + datapath: ./mem{{ '%0{}d'.format(3)|format(imember+1) }} + filename_nonrestart: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_ratmi{{ '%03d' % atmosphere_iau_hours[ihour] }}.nc + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_ice: icmr_inc + cloud_liquid_water: liq_wat_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + ozone_mass_mixing_ratio: o3mr_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc +{% endfor %} +{% endfor %} diff --git a/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_fv3inc_lgetkf.yaml.j2 b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_fv3inc_lgetkf.yaml.j2 new file mode 100644 index 000000000..9cf1fb727 --- /dev/null +++ b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_fv3inc_lgetkf.yaml.j2 @@ -0,0 +1,152 @@ +variable change: + variable change name: Model2GeoVaLs + input variables: &bkgvars + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - geopotential_height_at_surface + output variables: &fv3incrvars + - eastward_wind + - northward_wind + - air_temperature + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - air_pressure_thickness + - layer_thickness +jedi increment variables: +- eastward_wind +- northward_wind +- air_temperature +- air_pressure_at_surface +- water_vapor_mixing_ratio_wrt_moist_air +- cloud_liquid_ice +- cloud_liquid_water +- snow_water +- rain_water +- graupel +- ozone_mass_mixing_ratio +fv3 increment variables: *fv3incrvars +background geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_ges }} + npy: {{ atmosphere_npy_ges }} + npz: {{ atmosphere_npz_ges }} +jedi increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_ges }} + npy: {{ atmosphere_npy_ges }} + npz: {{ atmosphere_npz_ges }} +fv3 increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_ges }} + npy: {{ atmosphere_npy_ges }} + npz: {{ atmosphere_npz_ges }} +members from template: + template: + background input: + datapath: ./bkg/mem%mem% + filetype: cube sphere history + provider: ufs + filenames: + - {{ atmosphere_ensemble_history_prefix }}cubed_sphere_grid_atmf006.nc + - {{ atmosphere_ensemble_history_prefix }}cubed_sphere_grid_sfcf006.nc + max allowable geometry difference: 1e-4 + datetime: '{{ atmosphere_background_time_iso }}' + state variables: *bkgvars + field io names: &field_io_names + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + layer_thickness: delz + air_pressure_thickness: dpres + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr + geopotential_height_at_surface: hgtsfc + jedi increment input: + filetype: cube sphere history + provider: ufs + field io names: *field_io_names + datapath: ./anl/mem%mem% + filename: cubed_sphere_grid_atminc.jedi.nc + fv3 increment output: +{% if atm_enkfonly | default(false) %} + filetype: fms restart + is restart: false + filename_nonrestart: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_atminc.nc +{% else %} + filetype: cube sphere history + provider: ufs + filename: {{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_atminc.nc +{% endif %} + datapath: ./anl/mem%mem% + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_water: liq_wat_inc + ozone_mass_mixing_ratio: o3mr_inc + cloud_liquid_ice: icmr_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc + pattern: '%mem%' + nmembers: {{ atmosphere_number_ensemble_members }} + zero padding: 3 + +# Optionally test the application +{% if do_testing | default(false) %} +test: + reference filename: {{test_reference_filename}} +{% if test_output_filename is defined %} + test output filename: {{test_output_filename}} +{% endif %} +{% if log_output_filename is defined %} + log output filename: {{log_output_filename}} +{% endif %} +{% if mpi_pattern is defined %} + mpi pattern: {{mpi_pattern}} +{% endif %} + float relative tolerance: {{test_float_relative_tolerance | default(1.0e-6, true)}} + float absolute tolerance: {{test_float_absolute_tolerance | default(0.0, true) }} + integer tolerance: {{test_integer_tolerance | default(0, true) }} +{% endif %} diff --git a/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_fv3inc_variational.yaml.j2 b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_fv3inc_variational.yaml.j2 new file mode 100644 index 000000000..40da72655 --- /dev/null +++ b/parm/jcb-gdas/algorithm/atmosphere/fv3jedi_fv3inc_variational.yaml.j2 @@ -0,0 +1,147 @@ +variable change: + variable change name: Model2GeoVaLs + input variables: &bkgvars + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - ozone_mass_mixing_ratio + - snow_water + - rain_water + - graupel + - geopotential_height_at_surface + output variables: &fv3incrvars + - eastward_wind + - northward_wind + - air_temperature + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + - air_pressure_thickness + - layer_thickness +jedi increment variables: +- eastward_wind +- northward_wind +- air_temperature +- air_pressure_at_surface +- water_vapor_mixing_ratio_wrt_moist_air +- cloud_liquid_ice +- cloud_liquid_water +- snow_water +- rain_water +- graupel +- ozone_mass_mixing_ratio +fv3 increment variables: *fv3incrvars +background geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_ges }} + npy: {{ atmosphere_npy_ges }} + npz: {{ atmosphere_npz_ges }} +jedi increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_his }} + npy: {{ atmosphere_npy_his }} + npz: {{ atmosphere_npz_his }} +fv3 increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ atmosphere_layout_x }} + - {{ atmosphere_layout_y }} + npx: {{ atmosphere_npx_his }} + npy: {{ atmosphere_npy_his }} + npz: {{ atmosphere_npz_his }} +members: +- background input: + datapath: ./bkg + filetype: cube sphere history + provider: ufs + datetime: "{{ atmosphere_background_time_iso }}" + filenames: + - {{ atmosphere_variational_history_prefix }}cubed_sphere_grid_atmf006.nc + - {{ atmosphere_variational_history_prefix }}cubed_sphere_grid_sfcf006.nc + max allowable geometry difference: 1e-4 + state variables: *bkgvars + field io names: &field_io_names + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + layer_thickness: delz + air_pressure_thickness: dpres + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr + geopotential_height_at_surface: hgtsfc + jedi increment input: + filetype: cube sphere history + provider: ufs + field io names: *field_io_names + datapath: ./anl + filename: cubed_sphere_grid_atminc.jedi.nc + fv3 increment output: +{% if atmosphere_variational_increment_type == 'gaussian' %} + filetype: auxgrid + gridtype: gaussian + filename: ./anl/atminc. +{% else %} + filetype: fms restart + is restart: false + datapath: ./anl + filename_nonrestart: {{ atmosphere_variational_analysis_prefix }}cubed_sphere_grid_atminc.nc +{% endif %} + field io names: + eastward_wind: u_inc + northward_wind: v_inc + air_temperature: T_inc + water_vapor_mixing_ratio_wrt_moist_air: sphum_inc + cloud_liquid_water: liq_wat_inc + ozone_mass_mixing_ratio: o3mr_inc + cloud_liquid_ice: icmr_inc + snow_water: snmr_inc + rain_water: rwmr_inc + graupel: grle_inc + air_pressure_thickness: delp_inc + layer_thickness: delz_inc +# Optionally test the application +{% if do_testing | default(false) %} +test: + reference filename: {{test_reference_filename}} +{% if test_output_filename is defined %} + test output filename: {{test_output_filename}} +{% endif %} +{% if log_output_filename is defined %} + log output filename: {{log_output_filename}} +{% endif %} +{% if mpi_pattern is defined %} + mpi pattern: {{mpi_pattern}} +{% endif %} + float relative tolerance: {{test_float_relative_tolerance | default(1.0e-6, true)}} + float absolute tolerance: {{test_float_absolute_tolerance | default(0.0, true) }} + integer tolerance: {{test_integer_tolerance | default(0, true) }} +{% endif %} diff --git a/parm/jcb-gdas/algorithm/marine/soca_chgres.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_chgres.yaml.j2 new file mode 100644 index 000000000..2f417bc29 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_chgres.yaml.j2 @@ -0,0 +1,33 @@ +input geometry: + mom6_input_nml: mom_input.nml + fields metadata: ./fields_metadata.yaml + +output geometry: + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +states: +- input: + date: '{{ marine_window_end_iso }}' + basename: ./bkg/ + ocn_filename: 'ocean.bkg.f009.nc' + ice_filename: 'ice.bkg.f009.nc' + read_from_file: 1 + + state variables: + - sea_surface_height_above_geoid + - sea_water_potential_temperature + - sea_water_salinity + - sea_water_cell_thickness + - sea_water_depth + - mom6_mld + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + + output: + datadir: anl_geom/ + exp: f009_anl_geom + type: fc + date: '{{ marine_window_end_iso }}' \ No newline at end of file diff --git a/parm/jcb-gdas/algorithm/marine/soca_diag_stats.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_diag_stats.yaml.j2 new file mode 100644 index 000000000..8c774648c --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_diag_stats.yaml.j2 @@ -0,0 +1,18 @@ +time window: + begin: '1900-01-01T00:00:00Z' + end: '2035-01-01T00:00:00Z' + bound to include: begin +cycle date: {{ marine_window_middle_iso }} +obs spaces: +{% for observation_from_jcb in cleaned_observations %} +- obs space: + name: '{{ observation_from_jcb }}' + obsdatain: + engine: + type: H5File + obsfile: "{{ marine_obsdataout_path }}/{{ marine_obsdataout_prefix }}{{ observation_from_jcb }}{{ marine_obsdataout_suffix }}" + simulated variables: ['{{ obs_variables[observation_from_jcb] }}'] + variable: '{{ obs_variables[observation_from_jcb] }}' + experiment identifier: '{{ pslot }}' + csv output: '{{marine_obsdataout_path}}/{{ marine_obsdatain_prefix }}ocn.{{ observation_from_jcb }}.stats.csv' +{% endfor %} diff --git a/parm/jcb-gdas/algorithm/marine/soca_diagb.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_diagb.yaml.j2 new file mode 100644 index 000000000..8be8b26d5 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_diagb.yaml.j2 @@ -0,0 +1,51 @@ +geometry: + mom6_input_nml: mom_input.nml + fields metadata: ./fields_metadata.yaml + +output geometry: + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +date: '{{ marine_window_end_iso }}' + +background: + date: '{{ marine_window_end_iso }}' + basename: ./bkg/ + ocn_filename: 'ocean.bkg.f009.nc' + ice_filename: 'ice.bkg.f009.nc' + read_from_file: 1 + +background error: + datadir: ./staticb/ + date: '{{ marine_window_middle_iso }}' + exp: bkgerr_parametric_stddev + type: incr + +variables: + name: + - sea_water_potential_temperature + - sea_water_salinity +# - eastward_sea_water_velocity +# - northward_sea_water_velocity + - sea_water_cell_thickness + - sea_surface_height_above_geoid + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness +# - mom6_mld + + +vertical e-folding scale dynamic: 200.0 +vertical e-folding scale static: 300.0 +stencil growth iterations: 100 +min efold depth ratio: 3.0 +rescale dynamic: 0.2 +rescale static: 1.0 +static sig B: + sigT: 0.5 + sigS: 0.1 + sigSic: 0.01 +max ssh: 0.0 +min depth: 100.0 +vertical bin size: 1.0 diff --git a/parm/jcb-gdas/algorithm/marine/soca_diags_finalize.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_diags_finalize.yaml.j2 new file mode 100644 index 000000000..a05143b34 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_diags_finalize.yaml.j2 @@ -0,0 +1,8 @@ +copy_opt: +{% for observation_from_jcb in observations %} +{% if use_observer(observation_from_jcb) %} +- ['{{marine_obsdataout_path}}/{{observation_from_jcb}}{{marine_obsdataout_suffix}}', '{{marine_obsdatastats_path}}'] +- ['{{marine_obsdataout_path}}/{{marine_obsdatain_prefix}}ocn.{{observation_from_jcb}}.stats.csv', '{{marine_obsdatastats_path}}'] +{% endif %} +{% endfor %} +- ['{{marine_output_dir}}/soca_diag_stats.yaml', '{{marine_config_path}}'] diff --git a/parm/jcb-gdas/algorithm/marine/soca_ens_handler.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_ens_handler.yaml.j2 new file mode 100644 index 000000000..764a5b995 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_ens_handler.yaml.j2 @@ -0,0 +1,110 @@ +# This yaml is for applying deterministic recentering increments to the ensemble members +geometry: + mom6_input_nml: mom_input.nml + fields metadata: ./fields_metadata.yaml + +nens: '{{ marine_number_ensemble_members }}' +nens per MPI task: '{{ marine_number_ensemble_members_per_mpi }}' + +increment variables: &vars +- sea_water_potential_temperature +- sea_water_salinity +- eastward_sea_water_velocity +- northward_sea_water_velocity +- sea_ice_area_fraction +- sea_ice_thickness +- sea_ice_snow_thickness + +backgrounds: + members from template: + nmembers: '{{ marine_number_ensemble_members }}' + pattern: "%mem%" + template: + date: "{{ marine_window_end_iso }}" + basename: ./ens/ + ocn_filename: "ocean.%mem%.nc" + ice_filename: "ice.%mem%.nc" + read_from_file: 1 + state variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_water_cell_thickness + - eastward_sea_water_velocity + - northward_sea_water_velocity + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + +recentering state: + state variables: + - sea_water_potential_temperature + - sea_water_salinity + - eastward_sea_water_velocity + - northward_sea_water_velocity + - sea_water_cell_thickness + - sea_water_depth + - ocean_mixed_layer_thickness + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + date: "{{ marine_window_end_iso }}" + basename: ./bkg/ + ocn_filename: ocean.bkg.f009.nc + ice_filename: ice.bkg.f009.nc + read_from_file: 1 + +output increments: + datadir: ./ + date: "{{ marine_window_end_iso }}" + exp: recenter + type: ens + +increment postprocessing: + append vertical geometry: + layers variable: sea_water_cell_thickness + vertical geometry: + date: "{{ marine_window_begin_iso }}" + basename: ./INPUT/ + ocn_filename: MOM.res.nc + read_from_file: 3 + set increment variables to zero: + - eastward_sea_water_velocity + - northward_sea_water_velocity + +analysis postprocessing: + sea ice variable change: + variable change name: Soca2Cice + pattern: "%mem%" + arctic: + seaice edge: 0.4 + shuffle: true + rescale prior: + rescale: true + min hice: 0.5 + min hsno: 0.1 + antarctic: + seaice edge: 0.4 + shuffle: true + rescale prior: + rescale: true + min hice: 0.5 + min hsno: 0.1 + cice background state: + restart: ens/cice_model.res.%mem%.nc + ncat: 5 + ice_lev: 7 + sno_lev: 1 + cice output: + restart: ens/cice_model.res.%mem%.nc + output variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + +ensemble variance output: + datadir: ./ + date: "{{ marine_window_end_iso }}" + exp: ensvar + type: incr diff --git a/parm/jcb-gdas/algorithm/marine/soca_ensb.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_ensb.yaml.j2 new file mode 100644 index 000000000..9351877c7 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_ensb.yaml.j2 @@ -0,0 +1,122 @@ +# Configuration for the recentering and re-balancing of the ensemble members +geometry: + mom6_input_nml: mom_input.nml + fields metadata: ./fields_metadata.yaml + +output geometry: + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +date: '{{ marine_window_begin_iso }}' + +layers variable: [sea_water_cell_thickness] + +increment variables: +- sea_water_potential_temperature +- sea_water_salinity +- eastward_sea_water_velocity +- northward_sea_water_velocity +- sea_surface_height_above_geoid +- sea_water_cell_thickness +- sea_ice_area_fraction +- sea_ice_thickness +- sea_ice_snow_thickness + +set increment variables to zero: [sea_surface_height_above_geoid] + +vertical geometry: + date: '{{ marine_window_begin_iso }}' + basename: ./INPUT/ + ocn_filename: MOM.res.nc + read_from_file: 3 + +add recentering increment: false + +soca increments: # Could also be states, but they are read as increments + number of increments: '{{ marine_number_ensemble_members }}' + pattern: '%mem%' + template: + date: '{{ marine_window_begin_iso }}' + basename: '{{ marine_enspert_relpath }}/ens/' + ocn_filename: 'ocean.%mem%.nc' + ice_filename: 'ice.%mem%.nc' + read_from_file: 3 + +steric height: + linear variable changes: + - linear variable change name: BalanceSOCA # Only the steric balance is applied + +ensemble mean output: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: ens_mean + type: incr + +ssh output: + unbalanced: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: ssh_unbal_stddev + type: incr + + steric: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: ssh_steric_stddev + type: incr + + total: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: ssh_total_stddev + type: incr + + explained variance: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: steric_explained_variance + type: incr + + recentering error: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: ssh_recentering_error + type: incr + +background error output: + datadir: ./staticb/ + date: '{{ marine_window_begin_iso }}' + exp: bkgerr_ens_stddev + type: incr + +linear variable change: + linear variable changes: + - linear variable change name: BalanceSOCA + +trajectory: + state variables: + - sea_water_potential_temperature + - sea_water_salinity + - eastward_sea_water_velocity + - northward_sea_water_velocity + - sea_surface_height_above_geoid + - sea_water_cell_thickness + - sea_water_depth + - ocean_mixed_layer_thickness + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + date: '{{ marine_window_begin_iso }}' + basename: ./INPUT/ + ocn_filename: MOM.res.nc + ice_filename: cice.res.nc + read_from_file: 1 + +output increment: + datadir: '{{ marine_enspert_relpath }}/' + date: '{{ marine_window_begin_iso }}' + exp: trash + type: incr + output file: 'pert.%mem%.nc' + pattern: '%mem%' diff --git a/parm/jcb-gdas/algorithm/marine/soca_ensweights.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_ensweights.yaml.j2 new file mode 100644 index 000000000..00b2e1ef8 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_ensweights.yaml.j2 @@ -0,0 +1,52 @@ +geometry: + mom6_input_nml: mom_input.nml + fields metadata: ./fields_metadata.yaml + +output geometry: + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +date: '{{ marine_window_middle_iso }}' + +variables: + ice: + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + + ocean: + - sea_water_potential_temperature + - sea_water_salinity + - eastward_sea_water_velocity + - northward_sea_water_velocity + - sea_surface_height_above_geoid + +background: + date: '{{ marine_window_begin_iso }}' + basename: ./INPUT/ + ocn_filename: MOM.res.nc + ice_filename: cice.res.nc + read_from_file: 1 + +weights: + # Need to provide weights^2 when reading from file + ice: 0.0025 # 5% of original variance + ocean: 0.0625 # 25% " " + # Apply localized weights to the ocean ens. B + # Example below was for old ens. from Xiao + # ocean local weights: + # - lon: -172.0 + # lat: 11.0 + # amplitude: -1.0 + # length scale: 700.0 + # - lon: -160.0 + # lat: 12.0 + # amplitude: -1.0 + # length scale: 700.0 + +output: + datadir: ./ + date: '{{ marine_window_middle_iso }}' + exp: ens_weights + type: incr diff --git a/parm/jcb-gdas/algorithm/marine/soca_gridgen.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_gridgen.yaml.j2 new file mode 100644 index 000000000..34fbdeca6 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_gridgen.yaml.j2 @@ -0,0 +1,5 @@ +geometry: + geom_grid_file: soca_gridspec.nc + mom6_input_nml: mom_input.nml + fields metadata: fields_metadata.yaml + rossby file: rossrad.nc diff --git a/parm/jcb-gdas/algorithm/marine/soca_incpostproc.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_incpostproc.yaml.j2 new file mode 100644 index 000000000..a2f0c2ab9 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_incpostproc.yaml.j2 @@ -0,0 +1,115 @@ +geometry: + mom6_input_nml: mom_input.nml + fields metadata: ./fields_metadata.yaml + +date: '{{ marine_window_begin_iso }}' + +layers variable: [sea_water_cell_thickness] + +domains: [ocn, ice] + +increment variables: +- sea_water_potential_temperature +- sea_water_salinity +#- eastward_sea_water_velocity +#- northward_sea_water_velocity +- sea_surface_height_above_geoid # Not used in MOM6 iau +- sea_ice_area_fraction +- sea_ice_thickness +- sea_ice_snow_thickness + +set increment variables to zero: +- eastward_sea_water_velocity +- northward_sea_water_velocity + +vertical geometry: + date: '{{ marine_window_begin_iso }}' + basename: ./INPUT/ + ocn_filename: MOM.res.nc + read_from_file: 1 + +soca increment: + date: '{{ marine_window_begin_iso }}' + basename: ./Data/ + ocn_filename: 'ocn.3dvarfgat_pseudo.incr.{{ marine_window_middle_iso }}.nc' + ice_filename: 'ice.3dvarfgat_pseudo.incr.{{ marine_window_middle_iso }}.nc' + read_from_file: 1 + +output increment: + datadir: ./ + date: '{{ marine_window_begin_iso }}' + exp: mom6_iau + type: incr + output file: inc.nc + +increment precision: +- field: sea_water_potential_temperature + precision: 1.e-7 +- field: sea_water_salinity + precision: 1.e-7 +- field: sea_surface_height_above_geoid # Not used in MOM6 iau + precision: 1.e-7 +- field: sea_ice_area_fraction + precision: 1.e-7 + +qc increment: + state bounds: + sea_water_potential_temperature: [-2.5, 36.0] + sea_water_salinity: [0.0, 44.0] + increment max: + steric: 0.5 + increment stability iterations: 20 + min stable density gradient: 1e-4 + steric increment: + linear variable changes: + - linear variable change name: BalanceSOCA + +soca background: # background at the beginning of the window, used to compute analysis at the beginning of the window for soca2cice + date: '{{ marine_window_begin_iso }}' + basename: ./INPUT/ + ocn_filename: MOM.res.nc + ice_filename: cice.res.nc + read_from_file: 1 + state variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_surface_height_above_geoid + - eastward_sea_water_velocity + - northward_sea_water_velocity + - ocean_mixed_layer_thickness + - sea_water_depth + - sea_water_cell_thickness + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + +ice analysis postprocessing: + variable change name: Soca2Cice + arctic: + seaice edge: 0.4 + shuffle: true + rescale prior: + rescale: true + min hice: 0.5 + min hsno: 0.1 + antarctic: + seaice edge: 0.4 + shuffle: true + rescale prior: + rescale: true + min hice: 0.5 + min hsno: 0.1 + cice background state: + restart: ./Data/{{ marine_cice_date_fms }}.cice_model.res.nc + ncat: 5 + ice_lev: 7 + sno_lev: 1 + cice output: + restart: ./Data/{{ marine_cice_date_fms }}.cice_model.res.nc + output variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + diff --git a/parm/jcb-gdas/algorithm/marine/soca_parameters_diffusion_hz.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_parameters_diffusion_hz.yaml.j2 new file mode 100644 index 000000000..cb57948ab --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_parameters_diffusion_hz.yaml.j2 @@ -0,0 +1,43 @@ +# Analysis/B-mat resolution +geometry: &geom + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +# Background interpolated at the analysis resolution +background: + read_from_file: 1 + basename: ./anl_geom/ + ocn_filename: 'ocn.f009_anl_geom.fc.{{ marine_window_end_iso }}.PT0S.nc' + ice_filename: 'ice.f009_anl_geom.fc.{{ marine_window_end_iso }}.PT0S.nc' + date: '{{ marine_window_end_iso }}' + state variables: [sea_surface_height_above_geoid] + +background error: + covariance model: SABER + saber central block: + saber block name: diffusion + geometry: *geom + calibration: + normalization: + method: randomization + iterations: 1000 + + groups: + - horizontal: + model file: + date: '{{ marine_window_end_iso }}' + basename: ./ + ocn_filename: ocn.cor_rh.incr.0001-01-01T00:00:00Z.nc + model variable: sea_surface_height_above_geoid + write: + filepath: ./staticb/hz_ocean + +# TODO(G): OK to not use what's below but it will need +# to be fixed when we add ice thickness and +# snow depth +# - horizontal: +# as gaussian: true +# fixed value: 50000.0 +# write: +# filepath: ./staticb/hz_ice diff --git a/parm/jcb-gdas/algorithm/marine/soca_parameters_diffusion_vt.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_parameters_diffusion_vt.yaml.j2 new file mode 100644 index 000000000..a5c5d4641 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_parameters_diffusion_vt.yaml.j2 @@ -0,0 +1,36 @@ +# Analysis/B-mat resolution +geometry: &geom + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +# Background interpolated at the analysis resolution +background: + read_from_file: 1 + basename: ./anl_geom/ + ocn_filename: 'ocn.f009_anl_geom.fc.{{ marine_window_end_iso }}.PT0S.nc' + date: '{{ marine_window_end_iso }}' + state variables: [sea_water_potential_temperature] + +background error: + covariance model: SABER + saber central block: + saber block name: diffusion + geometry: *geom + calibration: + normalization: + # NOTE, not actually used here, since the normalization spec is only used for hz + method: randomization #< other option is "brute force" + iterations: 1000 #< in the real world you'll want to use 1e4 or so + + groups: + - vertical: + as gaussian: true + levels: '{{ marine_vt_levels }}' + model file: + date: '{{ marine_window_middle_iso }}' + basename: ./ + ocn_filename: vt_scales.nc + model variable: sea_water_potential_temperature + write: + filepath: ./staticb/vt_ocean diff --git a/parm/jcb-gdas/algorithm/marine/soca_setcorscales.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_setcorscales.yaml.j2 new file mode 100644 index 000000000..d87f3371f --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_setcorscales.yaml.j2 @@ -0,0 +1,30 @@ +resolution: + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: ./fields_metadata.yaml + +date: "0001-01-01T00:00:00Z" + +corr variables: [sea_surface_height_above_geoid] + +islands: + # Barrier Islands between the Pamlico Sound and the Atlantic + scale: 100.0 # in kilometers + lat: [ 34.636, 35.065, 35.49, 35.87, 36.28] + lon: [-76.52, -76.03, -75.46, -75.56, -75.78] + +scales: + vert layers: 5 # in units of layer + sea_surface_height_above_geoid: + rossby mult: 1.0 + min grid mult: 1.0 + +rh output: + datadir: ./ + exp: cor_rh + type: incr + +rv output: + datadir: ./ + exp: cor_rv + type: incr diff --git a/parm/jcb-gdas/algorithm/marine/soca_vtscales.yaml.j2 b/parm/jcb-gdas/algorithm/marine/soca_vtscales.yaml.j2 new file mode 100644 index 000000000..f0e68bc15 --- /dev/null +++ b/parm/jcb-gdas/algorithm/marine/soca_vtscales.yaml.j2 @@ -0,0 +1,13 @@ +gridspec_filename: ./anl_geom/soca_gridspec.nc +restart_filename: './anl_geom/ocn.f009_anl_geom.fc.{{ marine_window_end_iso }}.PT0S.nc' +mld_filename: './anl_geom/ocn.f009_anl_geom.fc.{{ marine_window_end_iso }}.PT0S.nc' +output_filename: ./vt_scales.nc +output_variable_vt: Temp +output_variable_hz: ave_ssh + +VT_MIN: 5 +VT_MAX: 15 + +HZ_ROSSBY_MULT: 1.0 +HZ_MAX: 200e3 +HZ_MIN_GRID_MULT: 2.0 diff --git a/parm/jcb-gdas/algorithm/observation_statistics/anlstat.yaml.j2 b/parm/jcb-gdas/algorithm/observation_statistics/anlstat.yaml.j2 new file mode 100644 index 000000000..420544cce --- /dev/null +++ b/parm/jcb-gdas/algorithm/observation_statistics/anlstat.yaml.j2 @@ -0,0 +1,11 @@ +time window: + begin: '{{ current_cycle_iso }}' + length: '{{ window_length }}' + bound to include: '{{ bound_to_include | default("begin", true) }}' + +observers: +{% for observation_from_jcb in observations %} +{% filter indent(width=2) %} +{% include observation_from_jcb + '.yaml.j2' %} +{% endfilter %} +{% endfor %} diff --git a/parm/jcb-gdas/algorithm/snow/fv3jedi_land_ensrecenter.yaml.j2 b/parm/jcb-gdas/algorithm/snow/fv3jedi_land_ensrecenter.yaml.j2 new file mode 100644 index 000000000..5d1eb1630 --- /dev/null +++ b/parm/jcb-gdas/algorithm/snow/fv3jedi_land_ensrecenter.yaml.j2 @@ -0,0 +1,94 @@ +geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ layout_x }} + - {{ layout_y }} + npx: {{ npx_ges }} + npy: {{ npy_ges }} + npz: {{ npz_ges }} +date: "{{ snow_background_time_iso }}" +variables: +- totalSnowDepth +increment mask: + variable: + - slmsk + minvalue: 0.99 + maxvalue: 1.01 + background: + datetime: "{{ snow_background_time_iso }}" + filetype: fms restart + state variables: + - slmsk + datapath: ./bkg/mem001 + filename is datetime templated: true + filename_core: "%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc" + filename_trcr: "%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc" + filename_sfcd: "%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc" + filename_sfcw: "%yyyy%mm%dd.%hh%MM%ss.fv_srf_wnd.res.nc" + filename_cplr: "%yyyy%mm%dd.%hh%MM%ss.coupler.res" + skip coupler file: true +deterministic increment: + datetime: "{{ snow_increment_time_iso }}" + filetype: fms restart + state variables: + - totalSnowDepth + field io names: + totalSnowDepth: snodl + datapath: ./inc/det_ensres + filename is datetime templated: true + filename_core: "snowinc.%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc" + filename_trcr: "snowinc.%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc" + filename_sfcd: "snowinc.%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc" + filename_sfcw: "snowinc.%yyyy%mm%dd.%hh%MM%ss.fv_srf_wnd.res.nc" + filename_cplr: "snowinc.%yyyy%mm%dd.%hh%MM%ss.coupler.res" + skip coupler file: true +deterministic background: + datetime: "{{ snow_background_time_iso }}" + filetype: fms restart + state variables: + - totalSnowDepth + field io names: + totalSnowDepth: snodl + datapath: ./bkg/det_ensres + filename is datetime templated: true + filename_core: "%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc" + filename_trcr: "%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc" + filename_sfcd: "%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc" + filename_sfcw: "%yyyy%mm%dd.%hh%MM%ss.fv_srf_wnd.res.nc" + filename_cplr: "%yyyy%mm%dd.%hh%MM%ss.coupler.res" + skip coupler file: true +recenter to: deterministic +output increment: + datapath: ./inc/ensmean + datetime: "{{ snow_increment_time_iso }}" + filetype: fms restart + field io names: + totalSnowDepth: snodl + prefix: snowinc + filename_core: "{{ snow_increment_time_fv3 }}.fv_core.res.nc" + filename_trcr: "{{ snow_increment_time_fv3 }}.fv_tracer.res.nc" + filename_sfcd: "{{ snow_increment_time_fv3 }}.sfc_data.nc" + filename_sfcw: "{{ snow_increment_time_fv3 }}.fv_srf_wnd.res.nc" + filename_cplr: "{{ snow_increment_time_fv3 }}.coupler.res" +ensemble backgrounds: + pattern: "{{ ensemble_pattern | default("%mem%", true) }}" + number of members: {{ number_ensemble_members }} + zero padding: 3 + template: + datetime: "{{ snow_background_time_iso }}" + filetype: fms restart + state variables: + - totalSnowDepth + field io names: + totalSnowDepth: snodl + datapath: ./bkg/mem%mem% + filename is datetime templated: true + filename_core: "%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc" + filename_trcr: "%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc" + filename_sfcd: "%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc" + filename_sfcw: "%yyyy%mm%dd.%hh%MM%ss.fv_srf_wnd.res.nc" + filename_cplr: "%yyyy%mm%dd.%hh%MM%ss.coupler.res" + skip coupler file: true diff --git a/parm/jcb-gdas/algorithm/snow/fv3jedi_snow_ensmean.yaml.j2 b/parm/jcb-gdas/algorithm/snow/fv3jedi_snow_ensmean.yaml.j2 new file mode 100644 index 000000000..9bd29e33a --- /dev/null +++ b/parm/jcb-gdas/algorithm/snow/fv3jedi_snow_ensmean.yaml.j2 @@ -0,0 +1,49 @@ +geometry: +{% filter indent(width=2) %} +{% set geometry_background_file = geometry_background_file|default(model_component ~ 'geometry_background', true) ~ '.yaml.j2' %} +{% include geometry_background_file %} +{% endfilter %} +mean output: + filetype: fms restart + datapath: ./bkg/ensmean + filename_core: fv_core.res.nc + filename_trcr: fv_tracer.res.nc + filename_sfcd: sfc_data.nc + filename_sfcw: fv_srf_wnd.res.nc + filename_cplr: coupler.res + state variables: + - totalSnowDepth + - vtype + - slmsk + - filtered_orography + - stc + - sheleg + - fraction_of_ice + field io names: + totalSnowDepth: snodl + filtered_orography: orog_filt + fraction_of_ice: fice +ensemble: + members from template: + template: + datetime: '{{ snow_background_time_iso }}' + filetype: fms restart + state variables: + - totalSnowDepth + - vtype + - slmsk + - filtered_orography + - stc + - sheleg + - fraction_of_ice + field io names: + totalSnowDepth: snodl + filtered_orography: orog_filt + fraction_of_ice: fice + datapath: ./bkg/mem%mem%/ + filename_sfcd: '{{ snow_background_time_fv3 }}.sfc_data.nc' + filename_cplr: '{{ snow_background_time_fv3 }}.coupler.res' + filename_orog: '{{ snow_orog_prefix }}_oro_data.nc' + pattern: '%mem%' + nmembers: {{ snow_number_ensemble_members }} + zero padding: 3 diff --git a/parm/jcb-gdas/algorithm/snow/snow_addincrement.yaml.j2 b/parm/jcb-gdas/algorithm/snow/snow_addincrement.yaml.j2 new file mode 100644 index 000000000..1ac692e0d --- /dev/null +++ b/parm/jcb-gdas/algorithm/snow/snow_addincrement.yaml.j2 @@ -0,0 +1,43 @@ +state geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ snow_layout_x }} + - {{ snow_layout_y }} + npx: {{ snow_npx_ges }} + npy: {{ snow_npy_ges }} + npz: {{ snow_npz_ges }} + field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_history.yaml +increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ snow_layout_x }} + - {{ snow_layout_y }} + npx: {{ snow_npx_ges }} + npy: {{ snow_npy_ges }} + npz: {{ snow_npz_ges }} + field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_restart.yaml +state: + datetime: '{{ snow_background_time_iso }}' + state variables: {{ analysis_variables }} + filetype: cube sphere history + provider: ufs + datapath: ./ + filename: {{ snow_variational_history_prefix }}cubed_sphere_grid_sfcf006.nc +increment: + added variables: {{ analysis_variables }} + filetype: fms restart + datapath: ./ + filename is datetime templated: true + filename_sfcd: '%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc' + prefix: snowinc +output: + filetype: auxgrid + gridtype: gaussian + datapath: ./ + filename: snowanl. diff --git a/parm/jcb-gdas/algorithm/snow/snow_ims_scf_preprocess.yaml.j2 b/parm/jcb-gdas/algorithm/snow/snow_ims_scf_preprocess.yaml.j2 new file mode 100644 index 000000000..7d5f4e9e0 --- /dev/null +++ b/parm/jcb-gdas/algorithm/snow/snow_ims_scf_preprocess.yaml.j2 @@ -0,0 +1,42 @@ +geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{snow_layout_x}} + - {{snow_layout_y}} + npx: {{ snow_npx_ges }} + npy: {{ snow_npy_ges }} + npz: {{ snow_npz_ges }} + time invariant fields: + state fields: + datapath: {{ snow_background_path }} + filetype: fms restart + skip coupler file: true + datetime: '{{ snow_background_time_iso }}' + state variables: + - filtered_orography + field io names: + filtered_orography: orog_filt + filename_sfcd: '{{ snow_background_time_fv3 }}.sfc_data.nc' + filename_cplr: '{{ snow_background_time_fv3 }}.coupler.res' + filename_orog: '{{ snow_orog_prefix }}_oro_data.nc' +date: '{{ snow_background_time_iso }}' +output ioda file: '{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}ims_snow.tm00.nc' +input scf file: './obs/ims{{ snow_background_time_julian }}_4km_v1.3.{{ ims_scf_obs_suffix }}' +mapping file: './obs/IMS4km_to_FV3_mapping.{{ snow_orog_prefix }}_oro_data.nc' +variables: +- totalSnowDepth +- vtype +- slmsk +- sheleg +- filtered_orography +- fraction_of_ice +- fraction_of_land +- stc +background: +{% filter indent(width=2) %} +{% set background_file = background_file|default(model_component ~ 'background', true) ~ '.yaml.j2' %} +{% include background_file %} +{% endfilter %} diff --git a/parm/jcb-gdas/algorithm/soil/soil_addincrement.yaml.j2 b/parm/jcb-gdas/algorithm/soil/soil_addincrement.yaml.j2 new file mode 100644 index 000000000..d6f01865f --- /dev/null +++ b/parm/jcb-gdas/algorithm/soil/soil_addincrement.yaml.j2 @@ -0,0 +1,74 @@ +state geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ soil_layout_x }} + - {{ soil_layout_y }} + npx: {{ soil_npx_ges }} + npy: {{ soil_npy_ges }} + npz: {{ soil_npz_ges }} +# field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_history.yaml +increment geometry: + fms initialization: + namelist filename: ./fv3jedi/fmsmpp.nml + field table filename: ./fv3jedi/field_table + akbk: ./fv3jedi/akbk.nc4 + layout: + - {{ soil_layout_x }} + - {{ soil_layout_y }} + npx: {{ soil_npx_anl }} + npy: {{ soil_npy_anl }} + npz: {{ soil_npz_anl }} +# field metadata override: ./fv3jedi/fv3jedi_fieldmetadata_fv3inc.yaml +state: + state variables: + - soilMoistureVolumetric + - stc + - totalSnowDepth + - sheleg + - vtype + - slmsk + - fraction_of_ice + field io names: + totalSnowDepth: snodl + soilMoistureVolumetric: smc + fraction_of_ice: fice + datapath: ./bkg + filetype: fms restart + skip coupler file: true + datetime: '{{ soil_background_time_iso }}' + filename_sfcd: {{ soil_background_time_fv3 }}.sfc_data.nc +increment: + added variables: + - soilMoistureVolumetric + field io names: + soilMoistureVolumetric: smc + datapath: ./anl + filetype: fms restart + skip coupler file: true + prefix: soilinc + filename is datetime templated: true + datetime: '{{ soil_background_time_iso }}' + filename_sfcd: {{ soil_background_time_fv3 }}.sfc_data.nc +output: + datapath: ./anl + prefix: soilanl + filetype: fms restart + skip coupler file: true + filename is datetime templated: true + datetime: '{{ soil_background_time_iso }}' + filename_sfcd: {{ soil_background_time_fv3 }}.sfc_data.nc + state variables: + - soilMoistureVolumetric + - stc + - totalSnowDepth + - sheleg + - vtype + - slmsk + - fraction_of_ice + field io names: + soilMoistureVolumetric: smc + totalSnowDepth: snodl + fraction_of_ice: fice diff --git a/parm/jcb-gdas/model/aero/aero_3dfgat_outer_loop_1.yaml.j2 b/parm/jcb-gdas/model/aero/aero_3dfgat_outer_loop_1.yaml.j2 new file mode 120000 index 000000000..be2ee77a8 --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_3dfgat_outer_loop_1.yaml.j2 @@ -0,0 +1 @@ +aero_3dvar_outer_loop_1.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/model/aero/aero_3dfgat_outer_loop_2.yaml.j2 b/parm/jcb-gdas/model/aero/aero_3dfgat_outer_loop_2.yaml.j2 new file mode 120000 index 000000000..d029b98df --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_3dfgat_outer_loop_2.yaml.j2 @@ -0,0 +1 @@ +aero_3dvar_outer_loop_2.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/model/aero/aero_3dvar_outer_loop_1.yaml.j2 b/parm/jcb-gdas/model/aero/aero_3dvar_outer_loop_1.yaml.j2 new file mode 100644 index 000000000..2c6183651 --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_3dvar_outer_loop_1.yaml.j2 @@ -0,0 +1,16 @@ +- ninner: 35 + gradient norm reduction: 1e-10 + test: on + geometry: + fms initialization: + namelist filename: {{aero_fv3jedi_files_path}}/fmsmpp.nml + field table filename: {{aero_fv3jedi_files_path}}/field_table + akbk: {{aero_fv3jedi_files_path}}/akbk.nc4 + layout: + - {{aero_layout_x}} + - {{aero_layout_y}} + npx: {{aero_npx_anl}} + npy: {{aero_npy_anl}} + npz: {{aero_npz_anl}} + diagnostics: + departures: bkgmob diff --git a/parm/jcb-gdas/model/aero/aero_3dvar_outer_loop_2.yaml.j2 b/parm/jcb-gdas/model/aero/aero_3dvar_outer_loop_2.yaml.j2 new file mode 100644 index 000000000..edd109797 --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_3dvar_outer_loop_2.yaml.j2 @@ -0,0 +1,16 @@ +- ninner: 35 + gradient norm reduction: 1e-10 + test: on + geometry: + fms initialization: + namelist filename: {{aero_fv3jedi_files_path}}/fmsmpp.nml + field table filename: {{aero_fv3jedi_files_path}}/field_table + akbk: {{aero_fv3jedi_files_path}}/akbk.nc4 + layout: + - {{aero_layout_x}} + - {{aero_layout_y}} + npx: {{aero_npx_anl}} + npy: {{aero_npy_anl}} + npz: {{aero_npz_anl}} + diagnostics: + departures: bkgmob1 diff --git a/parm/jcb-gdas/model/aero/aero_background.yaml.j2 b/parm/jcb-gdas/model/aero/aero_background.yaml.j2 new file mode 100644 index 000000000..daf6d4ef8 --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_background.yaml.j2 @@ -0,0 +1,43 @@ +datapath: {{ aero_background_path }} +filetype: fms restart +datetime: '{{ aero_background_time_iso }}' +filename is datetime templated: true +filename_core: '%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc' +filename_trcr: '%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc' +filename_cplr: '%yyyy%mm%dd.%hh%MM%ss.coupler.res' +state variables: +- air_temperature +- air_pressure_thickness +- water_vapor_mixing_ratio_wrt_moist_air +- mass_fraction_of_sulfate_in_air +- mass_fraction_of_hydrophobic_black_carbon_in_air +- mass_fraction_of_hydrophilic_black_carbon_in_air +- mass_fraction_of_hydrophobic_organic_carbon_in_air +- mass_fraction_of_hydrophilic_organic_carbon_in_air +- mass_fraction_of_dust001_in_air +- mass_fraction_of_dust002_in_air +- mass_fraction_of_dust003_in_air +- mass_fraction_of_dust004_in_air +- mass_fraction_of_dust005_in_air +- mass_fraction_of_sea_salt001_in_air +- mass_fraction_of_sea_salt002_in_air +- mass_fraction_of_sea_salt003_in_air +- mass_fraction_of_sea_salt004_in_air +field io names: + air_temperature: T + air_pressure_thickness: delp + water_vapor_mixing_ratio_wrt_moist_air: sphum + mass_fraction_of_sulfate_in_air: so4 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas2 + mass_fraction_of_sea_salt002_in_air: seas3 + mass_fraction_of_sea_salt003_in_air: seas4 + mass_fraction_of_sea_salt004_in_air: seas5 diff --git a/parm/jcb-gdas/model/aero/aero_background_error_static_diffusion.yaml.j2 b/parm/jcb-gdas/model/aero/aero_background_error_static_diffusion.yaml.j2 new file mode 100644 index 000000000..cb29115f3 --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_background_error_static_diffusion.yaml.j2 @@ -0,0 +1,53 @@ +covariance model: SABER +saber central block: + saber block name: diffusion + read: + groups: + - variables: + - mass_fraction_of_sulfate_in_air + - mass_fraction_of_hydrophobic_black_carbon_in_air + - mass_fraction_of_hydrophilic_black_carbon_in_air + - mass_fraction_of_hydrophobic_organic_carbon_in_air + - mass_fraction_of_hydrophilic_organic_carbon_in_air + - mass_fraction_of_dust001_in_air + - mass_fraction_of_dust002_in_air + - mass_fraction_of_dust003_in_air + - mass_fraction_of_dust004_in_air + - mass_fraction_of_dust005_in_air + - mass_fraction_of_sea_salt001_in_air + - mass_fraction_of_sea_salt002_in_air + - mass_fraction_of_sea_salt003_in_air + - mass_fraction_of_sea_salt004_in_air + horizontal: + filepath: "{{aero_berror_data_directory}}/diffusion_hz" + vertical: + levels: {{aero_npz_anl}} + filepath: "{{aero_berror_data_directory}}/diffusion_vt" +saber outer blocks: +- saber block name: StdDev + read: + model file: + datetime: "{{ aero_cycle_time_iso }}" + set datetime on read: true + filetype: fms restart + psinfile: true + datapath: "{{aero_berror_data_directory}}" + filename_core: '{{ aero_cycle_time_fv3 }}.stddev.fv_core.res.nc' + filename_trcr: '{{ aero_cycle_time_fv3 }}.stddev.fv_tracer.res.nc' + filename_cplr: '{{ aero_cycle_time_fv3 }}.stddev.coupler.res' + date: "{{ aero_cycle_time_iso }}" + field io names: + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas2 + mass_fraction_of_sea_salt002_in_air: seas3 + mass_fraction_of_sea_salt003_in_air: seas4 + mass_fraction_of_sea_salt004_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 diff --git a/parm/jcb-gdas/model/aero/aero_final_increment_cubed_sphere.yaml.j2 b/parm/jcb-gdas/model/aero/aero_final_increment_cubed_sphere.yaml.j2 new file mode 100644 index 000000000..74c96986b --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_final_increment_cubed_sphere.yaml.j2 @@ -0,0 +1,55 @@ +geometry: + fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" + akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{aero_layout_x}} + - {{aero_layout_y}} + npx: {{aero_npx_ges}} + npy: {{aero_npy_ges}} + npz: {{aero_npz_ges}} +output: + state component: + datapath: {{ aero_analysis_path }} + prefix: aeroinc + filetype: fms restart + filename_core: '{{ aero_cycle_time_fv3 }}.fv_core.res.nc' + filename_trcr: '{{ aero_cycle_time_fv3 }}.fv_tracer.res.nc' + filename_cplr: '{{ aero_cycle_time_fv3 }}.coupler.res' + state variables: + - air_temperature + - air_pressure_thickness + - water_vapor_mixing_ratio_wrt_moist_air + - mass_fraction_of_sulfate_in_air + - mass_fraction_of_hydrophobic_black_carbon_in_air + - mass_fraction_of_hydrophilic_black_carbon_in_air + - mass_fraction_of_hydrophobic_organic_carbon_in_air + - mass_fraction_of_hydrophilic_organic_carbon_in_air + - mass_fraction_of_dust001_in_air + - mass_fraction_of_dust002_in_air + - mass_fraction_of_dust003_in_air + - mass_fraction_of_dust004_in_air + - mass_fraction_of_dust005_in_air + - mass_fraction_of_sea_salt001_in_air + - mass_fraction_of_sea_salt002_in_air + - mass_fraction_of_sea_salt003_in_air + - mass_fraction_of_sea_salt004_in_air + field io names: + air_temperature: T + air_pressure_thickness: delp + water_vapor_mixing_ratio_wrt_moist_air: sphum + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas2 + mass_fraction_of_sea_salt002_in_air: seas3 + mass_fraction_of_sea_salt003_in_air: seas4 + mass_fraction_of_sea_salt004_in_air: seas5 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_sulfate_in_air: so4 diff --git a/parm/jcb-gdas/model/aero/aero_final_increment_gaussian.yaml.j2 b/parm/jcb-gdas/model/aero/aero_final_increment_gaussian.yaml.j2 new file mode 100644 index 000000000..87f0b689f --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_final_increment_gaussian.yaml.j2 @@ -0,0 +1,23 @@ +grid type: regular gaussian +local interpolator type: atlas interpolator +interpolation method: + type: finite-element +number of latitude gridpoints: {{ aero_npy_anl - 1 }} +variables to output: +- mass_fraction_of_sulfate_in_air +- mass_fraction_of_hydrophobic_black_carbon_in_air +- mass_fraction_of_hydrophilic_black_carbon_in_air +- mass_fraction_of_hydrophobic_organic_carbon_in_air +- mass_fraction_of_hydrophilic_organic_carbon_in_air +- mass_fraction_of_dust001_in_air +- mass_fraction_of_dust002_in_air +- mass_fraction_of_dust003_in_air +- mass_fraction_of_dust004_in_air +- mass_fraction_of_dust005_in_air +- mass_fraction_of_sea_salt001_in_air +- mass_fraction_of_sea_salt002_in_air +- mass_fraction_of_sea_salt003_in_air +- mass_fraction_of_sea_salt004_in_air +all model levels: true +datapath: {{ aero_analysis_path }} +prefix: aeroinc_gauss diff --git a/parm/jcb-gdas/model/aero/aero_geometry_background.yaml.j2 b/parm/jcb-gdas/model/aero/aero_geometry_background.yaml.j2 new file mode 100644 index 000000000..b55f395ab --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_geometry_background.yaml.j2 @@ -0,0 +1,10 @@ +fms initialization: + namelist filename: "{{aero_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{aero_fv3jedi_files_path}}/field_table" +akbk: "{{aero_fv3jedi_files_path}}/akbk.nc4" +layout: +- {{aero_layout_x}} +- {{aero_layout_y}} +npx: {{aero_npx_ges}} +npy: {{aero_npy_ges}} +npz: {{aero_npz_ges}} diff --git a/parm/jcb-gdas/model/aero/aero_model_pseudo.yaml.j2 b/parm/jcb-gdas/model/aero/aero_model_pseudo.yaml.j2 new file mode 100644 index 000000000..a5c879a5b --- /dev/null +++ b/parm/jcb-gdas/model/aero/aero_model_pseudo.yaml.j2 @@ -0,0 +1,46 @@ +name: PSEUDO +datapath: {{ aero_background_path}} +filetype: fms restart +filename is datetime templated: true +filename_core: '%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc' +filename_trcr: '%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc' +filename_sfcd: '%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc' +filename_sfcw: '%yyyy%mm%dd.%hh%MM%ss.fv_srf_wnd.res.nc' +filename_cplr: '%yyyy%mm%dd.%hh%MM%ss.coupler.res' +state variables: +- air_temperature +- air_pressure_thickness +- water_vapor_mixing_ratio_wrt_moist_air +- mass_fraction_of_sulfate_in_air +- mass_fraction_of_hydrophobic_black_carbon_in_air +- mass_fraction_of_hydrophilic_black_carbon_in_air +- mass_fraction_of_hydrophobic_organic_carbon_in_air +- mass_fraction_of_hydrophilic_organic_carbon_in_air +- mass_fraction_of_dust001_in_air +- mass_fraction_of_dust002_in_air +- mass_fraction_of_dust003_in_air +- mass_fraction_of_dust004_in_air +- mass_fraction_of_dust005_in_air +- mass_fraction_of_sea_salt001_in_air +- mass_fraction_of_sea_salt002_in_air +- mass_fraction_of_sea_salt003_in_air +- mass_fraction_of_sea_salt004_in_air +field io names: + air_temperature: T + air_pressure_thickness: delp + water_vapor_mixing_ratio_wrt_moist_air: sphum + mass_fraction_of_sulfate_in_air: so4 + mass_fraction_of_hydrophobic_black_carbon_in_air: bc1 + mass_fraction_of_hydrophilic_black_carbon_in_air: bc2 + mass_fraction_of_hydrophobic_organic_carbon_in_air: oc1 + mass_fraction_of_hydrophilic_organic_carbon_in_air: oc2 + mass_fraction_of_dust001_in_air: dust1 + mass_fraction_of_dust002_in_air: dust2 + mass_fraction_of_dust003_in_air: dust3 + mass_fraction_of_dust004_in_air: dust4 + mass_fraction_of_dust005_in_air: dust5 + mass_fraction_of_sea_salt001_in_air: seas2 + mass_fraction_of_sea_salt002_in_air: seas3 + mass_fraction_of_sea_salt003_in_air: seas4 + mass_fraction_of_sea_salt004_in_air: seas5 +tstep: {{aero_forecast_timestep}} diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_3dvar_outer_loop_1.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_3dvar_outer_loop_1.yaml.j2 new file mode 100644 index 000000000..bcb4a4600 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_3dvar_outer_loop_1.yaml.j2 @@ -0,0 +1,17 @@ +- ninner: {{atmosphere_ninner_1}} + gradient norm reduction: {{atmosphere_grad_red_1}} + test: on + geometry: + fms initialization: + namelist filename: {{atmosphere_fv3jedi_files_path}}/fmsmpp.nml + field table filename: {{atmosphere_fv3jedi_files_path}}/field_table + akbk: {{atmosphere_fv3jedi_files_path}}/akbk.nc4 + layout: + - {{atmosphere_layout_x}} + - {{atmosphere_layout_y}} + npx: {{atmosphere_npx_anl}} + npy: {{atmosphere_npy_anl}} + npz: {{atmosphere_npz_anl}} + vert coordinate: logp + diagnostics: + departures: bkgmob diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_3dvar_outer_loop_2.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_3dvar_outer_loop_2.yaml.j2 new file mode 100644 index 000000000..ab5b15d22 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_3dvar_outer_loop_2.yaml.j2 @@ -0,0 +1,17 @@ +- ninner: {{atmosphere_ninner_2}} + gradient norm reduction: {{atmosphere_grad_red_2}} + test: on + geometry: + fms initialization: + namelist filename: {{atmosphere_fv3jedi_files_path}}/fmsmpp.nml + field table filename: {{atmosphere_fv3jedi_files_path}}/field_table + akbk: {{atmosphere_fv3jedi_files_path}}/akbk.nc4 + layout: + - {{atmosphere_layout_x}} + - {{atmosphere_layout_y}} + npx: {{atmosphere_npx_anl}} + npy: {{atmosphere_npy_anl}} + npz: {{atmosphere_npz_anl}} + vert coordinate: logp + diagnostics: + departures: bkgmob1 diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_background.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_background.yaml.j2 new file mode 100644 index 000000000..f5a10238a --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_background.yaml.j2 @@ -0,0 +1,63 @@ +datapath: {{ atmosphere_background_path }} +filetype: cube sphere history +provider: ufs +datetime: "{{ atmosphere_background_time_iso }}" +filenames: +- {{ atmosphere_variational_history_prefix }}cubed_sphere_grid_atmf006.nc +- {{ atmosphere_variational_history_prefix }}cubed_sphere_grid_sfcf006.nc +max allowable geometry difference: 1e-4 +state variables: +- eastward_wind +- northward_wind +- air_temperature +- air_pressure_thickness +- air_pressure_at_surface +- water_vapor_mixing_ratio_wrt_moist_air +- cloud_liquid_ice +- cloud_liquid_water +- snow_water +- rain_water +- graupel +- cloud_ice_number_concentration +- rain_number_concentration +- ozone_mass_mixing_ratio +- geopotential_height_at_surface +- slmsk +- sheleg +- skin_temperature_at_surface +- vtype +- stype +- vfrac +- soilt +- soilm +- totalSnowDepthMeters +- eastward_wind_at_surface +- northward_wind_at_surface +- f10m +field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + layer_thickness: delz + air_pressure_thickness: dpres + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + cloud_ice_number_concentration: nccice + rain_number_concentration: nconrd + ozone_mass_mixing_ratio: o3mr + geopotential_height_at_surface: hgtsfc + slmsk: land + sheleg: weasd + skin_temperature_at_surface: tmpsfc + stype: sotyp + vfrac: veg + totalSnowDepthMeters: snod + eastward_wind_at_surface: ugrd_hyblev1 + northward_wind_at_surface: vgrd_hyblev1 + soilm: soilw1 + soilt: soilt1 diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_background_ensemble.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_background_ensemble.yaml.j2 new file mode 100644 index 000000000..a9e96487c --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_background_ensemble.yaml.j2 @@ -0,0 +1,71 @@ +datetime: '{{ atmosphere_background_time_iso }}' +members from template: + template: + datetime: '{{ atmosphere_background_time_iso }}' + filetype: cube sphere history + provider: ufs + state variables: + - eastward_wind + - northward_wind + - air_temperature + - layer_thickness + - air_pressure_thickness + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - cloud_ice_number_concentration + - rain_number_concentration + - ozone_mass_mixing_ratio + - geopotential_height_at_surface + - slmsk + - sheleg + - skin_temperature_at_surface + - vtype + - stype + - vfrac + - soilt + - soilm + - totalSnowDepthMeters + - eastward_wind_at_surface + - northward_wind_at_surface + - f10m + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + layer_thickness: delz + air_pressure_thickness: dpres + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + cloud_ice_number_concentration: nccice + rain_number_concentration: nconrd + ozone_mass_mixing_ratio: o3mr + geopotential_height_at_surface: hgtsfc + slmsk: land + sheleg: weasd + skin_temperature_at_surface: tmpsfc + stype: sotyp + vfrac: veg + totalSnowDepthMeters: snod + eastward_wind_at_surface: ugrd_hyblev1 + northward_wind_at_surface: vgrd_hyblev1 + soilm: soilw1 + soilt: soilt1 + datapath: {{ atmosphere_background_ensemble_path }} + filename is datetime templated: true + filenames: + - {{ atmosphere_ensemble_history_prefix }}cubed_sphere_grid_atmf006.nc + - {{ atmosphere_ensemble_history_prefix }}cubed_sphere_grid_sfcf006.nc + max allowable geometry difference: 1e-4 + pattern: "{{ atmosphere_ensemble_pattern | default("%mem%", true) }}" + nmembers: {{ atmosphere_number_ensemble_members }} + zero padding: 3 diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_hybrid_gsibec_bump.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_hybrid_gsibec_bump.yaml.j2 new file mode 100644 index 000000000..316dc6d6e --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_hybrid_gsibec_bump.yaml.j2 @@ -0,0 +1,290 @@ +covariance model: hybrid +components: +- covariance: + covariance model: SABER + saber central block: + saber block name: gsi static covariance + read: + gsi akbk: {{atmosphere_fv3jedi_files_path}}/akbk.nc4 + gsi error covariance file: {{atmosphere_gsibec_path}}/gsi-coeffs-gfs-global.nc4 + gsi berror namelist file: {{atmosphere_gsibec_path}}/gfs_gsi_global.nml + processor layout x direction: {{atmosphere_layout_gsib_x}} + processor layout y direction: {{atmosphere_layout_gsib_y}} + debugging mode: false + saber outer blocks: + - saber block name: interpolation + inner geometry: + function space: StructuredColumns + custom grid matching gsi: + type: gaussian + lats: {{ atmosphere_npy_ges + 1 }} + {% set atmosphere_lons = (atmosphere_npx_ges - 1) * 2 %} + lons: {{ atmosphere_lons }} + custom partitioner matching gsi: + bands: {{ atmosphere_layout_gsib_y }} + halo: 1 + forward interpolator: + local interpolator type: oops unstructured grid interpolator + inverse interpolator: + local interpolator type: oops unstructured grid interpolator + state variables to inverse: [eastward_wind,northward_wind,air_temperature,air_pressure_at_surface, + water_vapor_mixing_ratio_wrt_moist_air,cloud_liquid_ice,cloud_liquid_water, + snow_water,rain_water,graupel,ozone_mass_mixing_ratio] + linear variable change: + linear variable change name: Control2Analysis + input variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - mole_fraction_of_ozone_in_air + output variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + weight: + value: 0.125 +- covariance: + covariance model: ensemble + members from template: + template: + datetime: "{{ atmosphere_background_time_iso }}" + filetype: cube sphere history + provider: ufs + state variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr + datapath: {{ atmosphere_background_ensemble_path }} + filename is datetime templated: true + filenames: + - {{ atmosphere_ensemble_history_prefix }}cubed_sphere_grid_atmf006.nc + - {{ atmosphere_ensemble_history_prefix }}cubed_sphere_grid_sfcf006.nc + max allowable geometry difference: 1e-4 + pattern: "{{ atmosphere_ensemble_pattern | default("%mem%", true) }}" + nmembers: {{atmosphere_number_ensemble_members}} + zero padding: 3 + localization: + localization method: SABER + saber central block: + saber block name: BUMP_NICAS + active variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + read: + general: + universe length-scale: 4641.0e3 + drivers: + multivariate strategy: duplicated + compute nicas: true + model: + level for 2d variables: last + nicas: + resolution: 6 + explicit length-scales: true + horizontal length-scale: + - groups: + - common + profile: + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4641000.0 + - 4462500.0 + - 4462500.0 + - 4284000.0 + - 4284000.0 + - 4105500.0 + - 4105500.0 + - 3927000.0 + - 3927000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3570000.0 + - 3391500.0 + - 3391500.0 + - 3213000.0 + - 3213000.0 + - 3034500.0 + - 3034500.0 + - 2856000.0 + - 2856000.0 + - 2677500.0 + - 2677500.0 + - 2374050.0 + - 2374050.0 + - 2088450.0 + - 2088450.0 + - 1820700.0 + - 1820700.0 + - 1570800.0 + - 1570800.0 + - 1392300.0 + - 1392300.0 + - 1356600.0 + - 1356600.0 + - 1320900.0 + - 1320900.0 + - 1285200.0 + - 1285200.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + - 1249500.0 + vertical length-scale: + - groups: + - common + value: 1.8 + linear variable change: + linear variable change name: Control2Analysis + input variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + output variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + weight: + value: 0.875 diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_static_gsibec.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_static_gsibec.yaml.j2 new file mode 100644 index 000000000..2b6aa1700 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_static_gsibec.yaml.j2 @@ -0,0 +1,50 @@ +covariance model: SABER +full inverse: true +saber central block: + saber block name: gsi static covariance + read: + gsi akbk: {{atmosphere_fv3jedi_files_path}}/akbk.nc4 + gsi error covariance file: {{atmosphere_gsibec_path}}/gsi-coeffs-gfs-global.nc4 + gsi berror namelist file: {{atmosphere_gsibec_path}}/gfs_gsi_global.nml + processor layout x direction: {{atmosphere_layout_gsib_x}} + processor layout y direction: {{atmosphere_layout_gsib_y}} + debugging mode: false +saber outer blocks: +- saber block name: interpolation + inner geometry: + function space: StructuredColumns + custom grid matching gsi: + type: gaussian + lats: {{ atmosphere_npy_ges + 1 }} + {% set atmosphere_lons = (atmosphere_npx_ges - 1) * 2 %} + lons: {{ atmosphere_lons }} + custom partitioner matching gsi: + bands: {{ atmosphere_layout_gsib_y }} + halo: 1 + forward interpolator: + local interpolator type: oops unstructured grid interpolator + inverse interpolator: + local interpolator type: oops unstructured grid interpolator + state variables to inverse: [eastward_wind,northward_wind,air_temperature,air_pressure_at_surface, + water_vapor_mixing_ratio_wrt_moist_air,cloud_liquid_ice,cloud_liquid_water, + ozone_mass_mixing_ratio] +linear variable change: + linear variable change name: Control2Analysis + input variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - mole_fraction_of_ozone_in_air + output variables: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - ozone_mass_mixing_ratio diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_static_identity.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_static_identity.yaml.j2 new file mode 100644 index 000000000..a2533ec23 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_background_error_static_identity.yaml.j2 @@ -0,0 +1,2 @@ +covariance model: FV3JEDI-ID +date: "{{ atmosphere_background_time_iso }}" diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_cubed_sphere.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_cubed_sphere.yaml.j2 new file mode 100644 index 000000000..a3af136c4 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_cubed_sphere.yaml.j2 @@ -0,0 +1,40 @@ +output: + state component: + filetype: cube sphere history + filename: ./anl/cubed_sphere_grid_atminc.jedi.nc + provider: ufs + fields to write: + - eastward_wind + - northward_wind + - air_temperature + - air_pressure_at_surface + - water_vapor_mixing_ratio_wrt_moist_air + - cloud_liquid_ice + - cloud_liquid_water + - snow_water + - rain_water + - graupel + - ozone_mass_mixing_ratio + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr +geometry: + fms initialization: + namelist filename: "{{atmosphere_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{atmosphere_fv3jedi_files_path}}/field_table" + akbk: "{{atmosphere_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{atmosphere_layout_x}} + - {{atmosphere_layout_y}} + npx: {{atmosphere_npx_his}} + npy: {{atmosphere_npy_his}} + npz: {{atmosphere_npz_his}} diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_fms_nonrestart.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_fms_nonrestart.yaml.j2 new file mode 100644 index 000000000..efac27abe --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_fms_nonrestart.yaml.j2 @@ -0,0 +1,18 @@ +output: + state component: + filetype: fms restart + is restart: false + filename_nonrestart: ./anl/cubed_sphere_grid_atminc.jedi.nc + fields to write: [ua,va,t,ps,sphum,ice_wat,liq_wat,o3mr] +geometry: + fms initialization: + namelist filename: "{{atmosphere_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{atmosphere_fv3jedi_files_path}}/field_table" + akbk: "{{atmosphere_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{atmosphere_layout_x}} + - {{atmosphere_layout_y}} + npx: {{atmosphere_npx_ges}} + npy: {{atmosphere_npy_ges}} + npz: {{atmosphere_npz_ges}} + field metadata override: "{{atmosphere_fv3jedi_files_path}}/fv3jedi_fieldmetadata_fv3inc.yaml" diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_gaussian.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_gaussian.yaml.j2 new file mode 100644 index 000000000..ae88b090f --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_final_increment_gaussian.yaml.j2 @@ -0,0 +1,25 @@ +output: + state component: + filetype: auxgrid + gridtype: gaussian + filename: {{atmosphere_final_increment_prefix}} + field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + ozone_mass_mixing_ratio: o3mr +geometry: + fms initialization: + namelist filename: "{{atmosphere_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{atmosphere_fv3jedi_files_path}}/field_table" + akbk: "{{atmosphere_fv3jedi_files_path}}/akbk.nc4" + layout: + - {{atmosphere_layout_x}} + - {{atmosphere_layout_y}} + npx: {{atmosphere_npx_his}} + npy: {{atmosphere_npy_his}} + npz: {{atmosphere_npz_his}} diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_geometry_background.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_geometry_background.yaml.j2 new file mode 100644 index 000000000..54e847648 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_geometry_background.yaml.j2 @@ -0,0 +1,10 @@ +fms initialization: + namelist filename: "{{atmosphere_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{atmosphere_fv3jedi_files_path}}/field_table" +akbk: "{{atmosphere_fv3jedi_files_path}}/akbk.nc4" +layout: +- {{atmosphere_layout_x}} +- {{atmosphere_layout_y}} +npx: {{atmosphere_npx_ges}} +npy: {{atmosphere_npy_ges}} +npz: {{atmosphere_npz_ges}} diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_model_pseudo.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_model_pseudo.yaml.j2 new file mode 100644 index 000000000..74af652ba --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_model_pseudo.yaml.j2 @@ -0,0 +1,32 @@ +name: PSEUDO +datapath: {{ atmosphere_background_path}} +filetype: fms restart +filename is datetime templated: true +filename_core: '%yyyy%mm%dd.%hh%MM%ss.fv_core.res.nc' +filename_trcr: '%yyyy%mm%dd.%hh%MM%ss.fv_tracer.res.nc' +filename_sfcd: '%yyyy%mm%dd.%hh%MM%ss.sfc_data.nc' +filename_sfcw: '%yyyy%mm%dd.%hh%MM%ss.fv_srf_wnd.res.nc' +filename_cplr: '%yyyy%mm%dd.%hh%MM%ss.coupler.res' +tstep: {{atmosphere_forecast_timestep}} +field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + layer_thickness: delz + air_pressure_thickness: dpres + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + ozone_mass_mixing_ratio: o3mr + geopotential_height_at_surface: hgtsfc + slmsk: land + sheleg: weasd + skin_temperature_at_surface: tmpsfc + stype: sotyp + vfrac: veg + totalSnowDepthMeters: snod + eastward_wind_at_surface: ugrd_hyblev1 + northward_wind_at_surface: vgrd_hyblev1 + soilm: soilw1 + soilt: soilt1 diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_cubed_sphere.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_cubed_sphere.yaml.j2 new file mode 100644 index 000000000..7f159e380 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_cubed_sphere.yaml.j2 @@ -0,0 +1,15 @@ +filetype: cube sphere history +provider: ufs +filename: ./anl/mem%{member}%/cubed_sphere_grid_atminc.jedi.nc +field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + snow_water: snmr + rain_water: rwmr + graupel: grle + ozone_mass_mixing_ratio: o3mr diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_fms_nonrestart.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_fms_nonrestart.yaml.j2 new file mode 100644 index 000000000..ff021176f --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_fms_nonrestart.yaml.j2 @@ -0,0 +1,4 @@ +filetype: fms restart +is restart: false +datapath: ./anl/mem%{member}% +filename_nonrestart: cubed_sphere_grid_atminc.jedi.nc diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_gaussian.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_gaussian.yaml.j2 new file mode 100644 index 000000000..6d3d3b2af --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_output_ensemble_increments_gaussian.yaml.j2 @@ -0,0 +1,12 @@ +filetype: auxgrid +gridtype: gaussian +filename: {{atmosphere_ensemble_increment_prefix}} +field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + ozone_mass_mixing_ratio: o3mr diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_posterior_output_cubed_sphere.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_posterior_output_cubed_sphere.yaml.j2 new file mode 100644 index 000000000..aa72fc7e3 --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_posterior_output_cubed_sphere.yaml.j2 @@ -0,0 +1,5 @@ +filetype: cube sphere history +provider: ufs +ufs soil nlev: 4 +ufs fields split by level: [smc,stc] +filename: ./anl/{{ atmosphere_ensemble_analysis_prefix }}cubed_sphere_grid_atmanl.ensmean.nc diff --git a/parm/jcb-gdas/model/atmosphere/atmosphere_posterior_output_gaussian.yaml.j2 b/parm/jcb-gdas/model/atmosphere/atmosphere_posterior_output_gaussian.yaml.j2 new file mode 100644 index 000000000..a14180d5f --- /dev/null +++ b/parm/jcb-gdas/model/atmosphere/atmosphere_posterior_output_gaussian.yaml.j2 @@ -0,0 +1,12 @@ +filetype: auxgrid +gridtype: gaussian +filename: {{atmosphere_posterior_output_gaussian}} +field io names: + eastward_wind: ugrd + northward_wind: vgrd + air_temperature: tmp + air_pressure_at_surface: pressfc + water_vapor_mixing_ratio_wrt_moist_air: spfh + cloud_liquid_ice: icmr + cloud_liquid_water: clwmr + ozone_mass_mixing_ratio: o3mr diff --git a/parm/jcb-gdas/model/marine/marine_3dfgat_outer_loop_1.yaml.j2 b/parm/jcb-gdas/model/marine/marine_3dfgat_outer_loop_1.yaml.j2 new file mode 100644 index 000000000..e90d9ddc0 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_3dfgat_outer_loop_1.yaml.j2 @@ -0,0 +1,8 @@ +- ninner: {{marine_ninner_1}} + gradient norm reduction: {{marine_grad_red_1}} + geometry: + geom_grid_file: ./anl_geom/soca_gridspec.nc + mom6_input_nml: ./anl_geom/mom_input.nml + fields metadata: {{marine_soca_files_path}}/fields_metadata.yaml + diagnostics: + departures: ombg diff --git a/parm/jcb-gdas/model/marine/marine_background.yaml.j2 b/parm/jcb-gdas/model/marine/marine_background.yaml.j2 new file mode 100644 index 000000000..4be1f74fc --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_background.yaml.j2 @@ -0,0 +1,20 @@ +read_from_file: 1 +basename: {{ marine_background_path}} +ocn_filename: MOM.res.nc +ice_filename: cice.res.nc +date: "{{ marine_background_time }}" +state variables: +- sea_ice_area_fraction +- sea_ice_thickness +- sea_ice_snow_thickness +- snow_ice_surface_temperature +- air_temperature +- bulk_ice_salinity +- sea_water_salinity +- sea_water_potential_temperature +#- eastward_sea_water_velocity +#- northward_sea_water_velocity +- sea_surface_height_above_geoid +- sea_water_cell_thickness +- ocean_mixed_layer_thickness +- sea_water_depth diff --git a/parm/jcb-gdas/model/marine/marine_background_ensemble.yaml.j2 b/parm/jcb-gdas/model/marine/marine_background_ensemble.yaml.j2 new file mode 100644 index 000000000..911cf80ac --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_background_ensemble.yaml.j2 @@ -0,0 +1,10 @@ +members from template: + template: + date: '{{ marine_window_middle_iso }}' + ocn_filename: "ocean.%mem%.nc" + ice_filename: "ice.%mem%.nc" + read_from_file: 1 + basename: {{ marine_enspert_relpath }}/ens/ + state variables: [sea_water_salinity, sea_water_potential_temperature, sea_surface_height_above_geoid, sea_water_cell_thickness, eastward_sea_water_velocity, northward_sea_water_velocity, sea_ice_area_fraction] + pattern: '%mem%' + nmembers: {{ marine_number_ensemble_members }} diff --git a/parm/jcb-gdas/model/marine/marine_background_error_hybrid_diffusion_diffusion.yaml.j2 b/parm/jcb-gdas/model/marine/marine_background_error_hybrid_diffusion_diffusion.yaml.j2 new file mode 100644 index 000000000..6ff6713a4 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_background_error_hybrid_diffusion_diffusion.yaml.j2 @@ -0,0 +1,107 @@ +covariance model: hybrid +components: +- covariance: + covariance model: SABER + change background resolution: true + saber central block: + saber block name: diffusion + read: + groups: + - variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_surface_height_above_geoid + - sea_ice_area_fraction + horizontal: + filepath: ./staticb/hz_ocean + vertical: + levels: {{marine_vt_levels}} + filepath: ./staticb/vt_ocean + # TODO(G): OK to not use what's below but it will need + # to be fixed when we add ice thickness and + # snow depth + # - variables: [sea_ice_area_fraction] + # horizontal: + # filepath: ./staticb/hz_ice + + saber outer blocks: + - saber block name: StdDev + read: + model file: + date: '{{marine_stddev_time}}' + basename: ./staticb/ + ocn_filename: 'ocn.bkgerr_parametric_stddev.nc' + ice_filename: 'ice.bkgerr_parametric_stddev.nc' + read_from_file: 3 + linear variable change: + input variables: + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + - sea_water_salinity + - sea_water_potential_temperature + #- eastward_sea_water_velocity + #- northward_sea_water_velocity + - sea_surface_height_above_geoid + output variables: + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + - sea_water_salinity + - sea_water_potential_temperature + #- eastward_sea_water_velocity + #- northward_sea_water_velocity + - sea_surface_height_above_geoid + linear variable changes: + - linear variable change name: BalanceSOCA + weight: + value: 1.00 + +{% if marine_ensemble_b | default(false) %} +- covariance: + covariance model: SABER + ensemble: + members from template: + template: + read_from_file: 1 + date: '{{marine_stddev_time}}' + basename: ../ensdata/ + ocn_filename: ocn.pert.%mem%.nc + ice_filename: ice.pert.%mem%.nc + state variables: + - sea_water_potential_temperature + - sea_water_salinity + #- eastward_sea_water_velocity + #- northward_sea_water_velocity + - sea_surface_height_above_geoid + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + pattern: '%mem%' + nmembers: '{{marine_number_ensemble_members}}' + saber central block: + saber block name: Ensemble + localization: + saber central block: + saber block name: diffusion + read: + groups: + - variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_surface_height_above_geoid + - sea_ice_area_fraction + multivariate strategy: duplicated + horizontal: + filepath: ./staticb/hz_ocean + vertical: + strategy: duplicated + + weight: + read_from_file: 3 + basename: ./ + ocn_filename: 'ocean.ens_weights.nc' + ice_filename: 'ice.ens_weights.nc' + date: '{{marine_stddev_time}}' +{% endif %} + diff --git a/parm/jcb-gdas/model/marine/marine_background_error_static_diffusion.yaml.j2 b/parm/jcb-gdas/model/marine/marine_background_error_static_diffusion.yaml.j2 new file mode 100644 index 000000000..0d663c57f --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_background_error_static_diffusion.yaml.j2 @@ -0,0 +1,72 @@ +covariance model: SABER +change background resolution: true +saber central block: + saber block name: diffusion + read: + groups: + - variables: + - sea_water_potential_temperature + - sea_water_salinity + - sea_surface_height_above_geoid + - sea_ice_area_fraction + horizontal: + filepath: ./staticb/hz_ocean + vertical: + levels: {{marine_vt_levels}} + filepath: ./staticb/vt_ocean +# TODO(G): OK to not use what's below but it will need +# to be fixed when we add ice thickness and +# snow depth +# - variables: [sea_ice_area_fraction] +# horizontal: +# filepath: ./staticb/hz_ice + +saber outer blocks: +- saber block name: StdDev + read: + model file: + date: '{{marine_stddev_time}}' + basename: ./staticb/ + ocn_filename: 'ocn.bkgerr_parametric_stddev.nc' + ice_filename: 'ice.bkgerr_parametric_stddev.nc' + read_from_file: 3 + +#- saber block name: MLBalance +# geometry: +# mom6_input_nml: mom_input.nml +# fields metadata: ./fields_metadata.yaml +# ML Balances: +# arctic: +# ffnn: +# inputSize: 7 +# outputSize: 1 +# hiddenSize: 2 +# load model: /work/noaa/da/gvernier/ai/runs/arctic.pt +# antarctic: +# ffnn: +# inputSize: 7 +# outputSize: 1 +# hiddenSize: 2 +# load model: /work/noaa/da/gvernier/ai/runs/antarctic.pt + +linear variable change: + input variables: + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + - sea_water_salinity + - sea_water_potential_temperature + #- eastward_sea_water_velocity + #- northward_sea_water_velocity + - sea_surface_height_above_geoid + output variables: + - sea_ice_area_fraction + - sea_ice_thickness + - sea_ice_snow_thickness + - sea_water_salinity + - sea_water_potential_temperature + #- eastward_sea_water_velocity + #- northward_sea_water_velocity + - sea_surface_height_above_geoid + linear variable changes: + - linear variable change name: BalanceSOCA diff --git a/parm/jcb-gdas/model/marine/marine_final_increment.yaml.j2 b/parm/jcb-gdas/model/marine/marine_final_increment.yaml.j2 new file mode 100644 index 000000000..ead7a3ed1 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_final_increment.yaml.j2 @@ -0,0 +1,9 @@ +output: + state component: + datadir: {{marine_final_increment_dir}} + date: '{{marine_window_begin}}' + exp: {{marine_final_increment_exp}} + type: incr +geometry: + mom6_input_nml: mom_input.nml + fields metadata: {{marine_soca_files_path}}/fields_metadata.yaml diff --git a/parm/jcb-gdas/model/marine/marine_geometry_background.yaml.j2 b/parm/jcb-gdas/model/marine/marine_geometry_background.yaml.j2 new file mode 100644 index 000000000..2ab3b6789 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_geometry_background.yaml.j2 @@ -0,0 +1,2 @@ +mom6_input_nml: mom_input.nml +fields metadata: {{marine_soca_files_path}}/fields_metadata.yaml diff --git a/parm/jcb-gdas/model/marine/marine_model_pseudo.yaml.j2 b/parm/jcb-gdas/model/marine/marine_model_pseudo.yaml.j2 new file mode 100644 index 000000000..9188340bb --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_model_pseudo.yaml.j2 @@ -0,0 +1,10 @@ +name: PseudoModel +tstep: {{marine_forecast_timestep}} +states: +{% for marine_pseudo_model_state in marine_pseudo_model_states %} +- date: '{{ marine_pseudo_model_state.date }}' + basename: '{{ marine_pseudo_model_state.basename }}' + ocn_filename: '{{ marine_pseudo_model_state.ocn_filename }}' + ice_filename: '{{ marine_pseudo_model_state.ice_filename }}' + read_from_file: {{ marine_pseudo_model_state.read_from_file }} +{% endfor %} diff --git a/parm/jcb-gdas/model/marine/marine_output.yaml.j2 b/parm/jcb-gdas/model/marine/marine_output.yaml.j2 new file mode 100644 index 000000000..2c8e2adb9 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_output.yaml.j2 @@ -0,0 +1,4 @@ +datadir: {{marine_output_dir}} +exp: {{marine_output_exp}} +type: an +frequency: {{marine_output_freq}} diff --git a/parm/jcb-gdas/model/marine/marine_output_increment.yaml.j2 b/parm/jcb-gdas/model/marine/marine_output_increment.yaml.j2 new file mode 100644 index 000000000..4cae31926 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_output_increment.yaml.j2 @@ -0,0 +1,4 @@ +datadir: letkf_output/ +date: '{{ marine_window_begin_iso }}' +exp: letkf.inc +type: ens diff --git a/parm/jcb-gdas/model/marine/marine_output_mean_prior.yaml.j2 b/parm/jcb-gdas/model/marine/marine_output_mean_prior.yaml.j2 new file mode 100644 index 000000000..20fedd4c5 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_output_mean_prior.yaml.j2 @@ -0,0 +1,4 @@ +datadir: letkf_output/ +date: '{{ marine_window_begin_iso }}' +exp: letkf.mean_prior +type: fc diff --git a/parm/jcb-gdas/model/marine/marine_output_variance_posterior.yaml.j2 b/parm/jcb-gdas/model/marine/marine_output_variance_posterior.yaml.j2 new file mode 100644 index 000000000..734344d98 --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_output_variance_posterior.yaml.j2 @@ -0,0 +1,4 @@ +datadir: letkf_output/ +date: '{{ marine_window_begin_iso }}' +exp: letkf.var_post +type: an diff --git a/parm/jcb-gdas/model/marine/marine_output_variance_prior.yaml.j2 b/parm/jcb-gdas/model/marine/marine_output_variance_prior.yaml.j2 new file mode 100644 index 000000000..de97f917c --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_output_variance_prior.yaml.j2 @@ -0,0 +1,4 @@ +datadir: letkf_output/ +date: '{{ marine_window_begin_iso }}' +exp: letkf.var_prior +type: fc diff --git a/parm/jcb-gdas/model/marine/marine_posterior_output.yaml.j2 b/parm/jcb-gdas/model/marine/marine_posterior_output.yaml.j2 new file mode 100644 index 000000000..fc823ea8d --- /dev/null +++ b/parm/jcb-gdas/model/marine/marine_posterior_output.yaml.j2 @@ -0,0 +1,4 @@ +datadir: letkf_output/ +date: '{{ marine_window_begin_iso }}' +exp: letkf +type: ens diff --git a/parm/jcb-gdas/model/snow/snow_3dvar_outer_loop_1.yaml.j2 b/parm/jcb-gdas/model/snow/snow_3dvar_outer_loop_1.yaml.j2 new file mode 100644 index 000000000..53085b711 --- /dev/null +++ b/parm/jcb-gdas/model/snow/snow_3dvar_outer_loop_1.yaml.j2 @@ -0,0 +1,29 @@ +- ninner: 50 + gradient norm reduction: 1e-10 + test: on + geometry: + fms initialization: + namelist filename: {{ snow_fv3jedi_files_path }}/fmsmpp.nml + field table filename: {{ snow_fv3jedi_files_path }}/field_table + akbk: {{ snow_fv3jedi_files_path }}/akbk.nc4 + layout: + - {{ snow_layout_x }} + - {{ snow_layout_y }} + npx: {{ snow_npx_anl }} + npy: {{ snow_npy_anl }} + npz: {{ snow_npz_anl }} + time invariant fields: + state fields: + datetime: '{{ snow_background_time_iso }}' + filetype: fms restart + skip coupler file: true + state variables: + - filtered_orography + - fraction_of_land + field io names: + filtered_orography: orog_filt + fraction_of_land: land_frac + datapath: {{ snow_orog_files_path }}/ + filename_orog: {{ snow_orog_prefix }}_oro_data.nc + diagnostics: + departures: bkgmob diff --git a/parm/jcb-gdas/model/snow/snow_background.yaml.j2 b/parm/jcb-gdas/model/snow/snow_background.yaml.j2 new file mode 100644 index 000000000..1f1ccb57b --- /dev/null +++ b/parm/jcb-gdas/model/snow/snow_background.yaml.j2 @@ -0,0 +1,21 @@ +datapath: {{ snow_background_path }} +filetype: fms restart +skip coupler file: true +datetime: '{{ snow_background_time_iso }}' +state variables: +- totalSnowDepth +- vtype +- slmsk +- sheleg +- filtered_orography +- fraction_of_ice +- fraction_of_land +- stc +field io names: + totalSnowDepth: snodl + filtered_orography: orog_filt + fraction_of_ice: fice + fraction_of_land: land_frac +filename_sfcd: '{{ snow_background_time_fv3 }}.sfc_data.nc' +filename_cplr: '{{ snow_background_time_fv3 }}.coupler.res' +filename_orog: '{{ snow_orog_prefix }}_oro_data.nc' diff --git a/parm/jcb-gdas/model/snow/snow_background_error.yaml.j2 b/parm/jcb-gdas/model/snow/snow_background_error.yaml.j2 new file mode 100644 index 000000000..3d853038a --- /dev/null +++ b/parm/jcb-gdas/model/snow/snow_background_error.yaml.j2 @@ -0,0 +1,47 @@ +covariance model: SABER +saber central block: + saber block name: BUMP_NICAS + read: + general: + universe length-scale: 300000.0 + drivers: + multivariate strategy: univariate + read global nicas: true + nicas: + explicit length-scales: true + horizontal length-scale: + - groups: + - totalSnowDepth_shadowLevels + value: 250000.0 + vertical length-scale: + - groups: + - totalSnowDepth_shadowLevels + value: 0.0 + interpolation type: + - groups: + - totalSnowDepth_shadowLevels + type: c0 + same horizontal convolution: true + io: + data directory: {{snow_bump_data_directory}} + files prefix: snow_bump_nicas_250km_shadowlevels +saber outer blocks: +- saber block name: ShadowLevels + fields metadata: + totalSnowDepth: + vert_coord: filtered_orography + calibration: + number of shadow levels: 50 + lowest shadow level: -450.0 + highest shadow level: 8850.0 + vertical length-scale: 2000.0 +- saber block name: BUMP_StdDev + read: + drivers: + compute variance: true + variance: + explicit stddev: true + stddev: + - variables: + - totalSnowDepth + value: 30.0 diff --git a/parm/jcb-gdas/model/snow/snow_final_increment_fms.yaml.j2 b/parm/jcb-gdas/model/snow/snow_final_increment_fms.yaml.j2 new file mode 100644 index 000000000..7c9e13e23 --- /dev/null +++ b/parm/jcb-gdas/model/snow/snow_final_increment_fms.yaml.j2 @@ -0,0 +1,24 @@ +output: + state component: + datapath: ./anl + prefix: snowinc + filetype: fms restart + filename_sfcd: '{{ snow_background_time_fv3 }}.sfc_data.nc' + filename_cplr: '{{ snow_background_time_fv3 }}.coupler.res' + state variables: + - totalSnowDepth + - vtype + - slmsk + field io names: + totalSnowDepth: snodl +geometry: + fms initialization: + namelist filename: "{{ snow_fv3jedi_files_path }}/fmsmpp.nml" + field table filename: "{{ snow_fv3jedi_files_path }}/field_table" + akbk: "{{ snow_fv3jedi_files_path }}/akbk.nc4" + layout: + - {{ snow_layout_x }} + - {{ snow_layout_y }} + npx: {{ snow_npx_ges }} + npy: {{ snow_npy_ges }} + npz: {{ snow_npz_ges }} diff --git a/parm/jcb-gdas/model/snow/snow_geometry_background.yaml.j2 b/parm/jcb-gdas/model/snow/snow_geometry_background.yaml.j2 new file mode 100644 index 000000000..ff72e6222 --- /dev/null +++ b/parm/jcb-gdas/model/snow/snow_geometry_background.yaml.j2 @@ -0,0 +1,10 @@ +fms initialization: + namelist filename: "{{snow_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{snow_fv3jedi_files_path}}/field_table" +akbk: "{{snow_fv3jedi_files_path}}/akbk.nc4" +layout: +- {{snow_layout_x}} +- {{snow_layout_y}} +npx: {{snow_npx_ges}} +npy: {{snow_npy_ges}} +npz: {{snow_npz_ges}} diff --git a/parm/jcb-gdas/model/soil/soil_3dvar_outer_loop_1.yaml.j2 b/parm/jcb-gdas/model/soil/soil_3dvar_outer_loop_1.yaml.j2 new file mode 100644 index 000000000..302fd4a33 --- /dev/null +++ b/parm/jcb-gdas/model/soil/soil_3dvar_outer_loop_1.yaml.j2 @@ -0,0 +1,29 @@ +- ninner: 50 + gradient norm reduction: 1e-10 + test: on + geometry: + fms initialization: + namelist filename: {{ soil_fv3jedi_files_path }}/fmsmpp.nml + field table filename: {{ soil_fv3jedi_files_path }}/field_table + akbk: {{ soil_fv3jedi_files_path }}/akbk.nc4 + layout: + - {{ soil_layout_x }} + - {{ soil_layout_y }} + npx: {{ soil_npx_anl }} + npy: {{ soil_npy_anl }} + npz: {{ soil_npz_anl }} + time invariant fields: + state fields: + datetime: '{{ soil_background_time_iso }}' + filetype: fms restart + skip coupler file: true + state variables: + - filtered_orography + - fraction_of_land + field io names: + filtered_orography: orog_filt + fraction_of_land: land_frac + datapath: {{ soil_orog_files_path }}/ + filename_orog: {{ soil_orog_prefix }}_oro_data.nc + diagnostics: + departures: bkgmob diff --git a/parm/jcb-gdas/model/soil/soil_background.yaml.j2 b/parm/jcb-gdas/model/soil/soil_background.yaml.j2 new file mode 100644 index 000000000..c495e93f9 --- /dev/null +++ b/parm/jcb-gdas/model/soil/soil_background.yaml.j2 @@ -0,0 +1,23 @@ +datapath: {{ soil_background_path }} +filetype: fms restart +skip coupler file: true +datetime: '{{ soil_background_time_iso }}' +state variables: +- soilMoistureVolumetric +- stc +- totalSnowDepth +- sheleg +- vtype +- slmsk +- filtered_orography +- fraction_of_ice +- fraction_of_land +field io names: + soilMoistureVolumetric: smc + totalSnowDepth: snodl + filtered_orography: orog_filt + fraction_of_ice: fice + fraction_of_land: land_frac +filename_sfcd: '{{ soil_background_time_fv3 }}.sfc_data.nc' +filename_cplr: '{{ soil_background_time_fv3 }}.coupler.res' +filename_orog: '{{ soil_orog_prefix }}_oro_data.nc' diff --git a/parm/jcb-gdas/model/soil/soil_background_error.yaml.j2 b/parm/jcb-gdas/model/soil/soil_background_error.yaml.j2 new file mode 100644 index 000000000..c1220bea3 --- /dev/null +++ b/parm/jcb-gdas/model/soil/soil_background_error.yaml.j2 @@ -0,0 +1,40 @@ +covariance model: SABER +saber central block: + saber block name: BUMP_NICAS + calibration: #read: + general: + universe length-scale: 5000000.0 + drivers: + multivariate strategy: univariate + compute nicas: true #read global nicas: true + write global nicas: true + nicas: + resolution: 4 + explicit length-scales: true + horizontal length-scale: + - groups: + - soilMoistureVolumetric + value: 1000000.0 + vertical length-scale: + - groups: + - soilMoistureVolumetric + value: 1500.0 + interpolation type: + - groups: + - soilMoistureVolumetric + type: c0 + same horizontal convolution: true + io: + data directory: ./berror + files prefix: smc_bump_nicas_1000km_{{ soil_background_time_fv3 }} +saber outer blocks: +- saber block name: BUMP_StdDev + read: + drivers: + compute variance: true + variance: + explicit stddev: true + stddev: + - variables: + - soilMoistureVolumetric + value: 0.2 diff --git a/parm/jcb-gdas/model/soil/soil_final_increment_fms.yaml.j2 b/parm/jcb-gdas/model/soil/soil_final_increment_fms.yaml.j2 new file mode 100644 index 000000000..b3a7f22f8 --- /dev/null +++ b/parm/jcb-gdas/model/soil/soil_final_increment_fms.yaml.j2 @@ -0,0 +1,28 @@ +output: + state component: + datapath: ./anl + prefix: soilinc + filetype: fms restart + filename_sfcd: '{{ soil_background_time_fv3 }}.sfc_data.nc' + filename_cplr: '{{ soil_background_time_fv3 }}.coupler.res' + state variables: + - soilMoistureVolumetric + - stc + - totalSnowDepth + - sheleg + - vtype + - slmsk + field io names: + soilMoistureVolumetric: smc + totalSnowDepth: snodl +geometry: + fms initialization: + namelist filename: "{{ soil_fv3jedi_files_path }}/fmsmpp.nml" + field table filename: "{{ soil_fv3jedi_files_path }}/field_table" + akbk: "{{ soil_fv3jedi_files_path }}/akbk.nc4" + layout: + - {{ soil_layout_x }} + - {{ soil_layout_y }} + npx: {{ soil_npx_ges }} + npy: {{ soil_npy_ges }} + npz: {{ soil_npz_ges }} diff --git a/parm/jcb-gdas/model/soil/soil_geometry_background.yaml.j2 b/parm/jcb-gdas/model/soil/soil_geometry_background.yaml.j2 new file mode 100644 index 000000000..d60dc8a36 --- /dev/null +++ b/parm/jcb-gdas/model/soil/soil_geometry_background.yaml.j2 @@ -0,0 +1,10 @@ +fms initialization: + namelist filename: "{{soil_fv3jedi_files_path}}/fmsmpp.nml" + field table filename: "{{soil_fv3jedi_files_path}}/field_table" +akbk: "{{soil_fv3jedi_files_path}}/akbk.nc4" +layout: +- {{soil_layout_x}} +- {{soil_layout_y}} +npx: {{soil_npx_ges}} +npy: {{soil_npy_ges}} +npz: {{soil_npz_ges}} diff --git a/parm/jcb-gdas/model/soil/soil_output.yaml.j2 b/parm/jcb-gdas/model/soil/soil_output.yaml.j2 new file mode 100644 index 000000000..83e44b6ee --- /dev/null +++ b/parm/jcb-gdas/model/soil/soil_output.yaml.j2 @@ -0,0 +1,23 @@ +state variables: +- soilMoistureVolumetric +- stc +- totalSnowDepth +- sheleg +- vtype +- slmsk +- filtered_orography +- fraction_of_ice +- fraction_of_land +field io names: + soilMoistureVolumetric: smc + totalSnowDepth: snodl + filtered_orography: orog_filt + fraction_of_ice: fice + fraction_of_land: land_frac +datapath: ./anl +prefix: soil_finanl +filetype: fms restart +datetime: '{{ soil_background_time_iso }}' +filename_sfcd: '{{ soil_background_time_fv3 }}.sfc_data.nc' +filename_cplr: '{{ soil_background_time_fv3 }}.coupler.res' +filename_orog: '{{ soil_orog_prefix }}_oro_data.nc' diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_abi_g16.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_abi_g16.yaml new file mode 100644 index 000000000..cf76cd889 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_abi_g16.yaml @@ -0,0 +1,29 @@ +# Instrument metadata +# ------------------- +commissioned: 2017-12-18T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + +channel_values: +# sim act bcd err errcld ermax + 7: [ 1, -1, -1, 1.40, 0.00, 2.50 ] + 8: [ 1, 1, -1, 3.00, 0.00, 4.00 ] + 9: [ 1, -1, -1, 2.50, 0.00, 4.00 ] + 10: [ 1, 1, -1, 2.20, 0.00, 3.50 ] + 11: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 12: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 13: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 14: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 15: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 16: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + + diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_abi_g17.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_abi_g17.yaml new file mode 100644 index 000000000..b891419b9 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_abi_g17.yaml @@ -0,0 +1,29 @@ +# Instrument metadata +# ------------------- +commissioned: 2019-02-12T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + +channel_values: +# sim act bcd err errcld ermax + 7: [ 1, -1, -1, 1.40, 0.00, 2.50 ] + 8: [ 1, -1, -1, 3.00, 0.00, 4.00 ] + 9: [ 1, -1, -1, 2.50, 0.00, 4.00 ] + 10: [ 1, -1, -1, 2.20, 0.00, 3.50 ] + 11: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 12: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 13: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 14: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 15: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + 16: [ 1, -1, -1, 2.00, 0.00, 2.50 ] + + diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_amsr2_gcom-w1.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_amsr2_gcom-w1.yaml new file mode 100644 index 000000000..d445480a3 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_amsr2_gcom-w1.yaml @@ -0,0 +1,32 @@ +# Instrument metadata +# ------------------- +commissioned: 2024-10-01T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + x0: max + x1: max +channel_values: +# sim act bcd err errcld ermax x0 x1 + 1: [ 1, -1, 1, 0.80, 5.00, 2.40, 0.050, 0.600] + 2: [ 1, -1, 1, 0.90, 5.00, 2.70, 0.100, 0.600] + 3: [ 1, -1, 1, 0.80, 5.00, 2.40, 0.050, 0.600] + 4: [ 1, -1, 1, 0.90, 5.00, 2.70, 0.050, 0.600] + 5: [ 1, -1, 1, 1.00, 5.00, 3.00, 0.100, 0.600] + 6: [ 1, -1, 1, 1.10, 18.50, 3.30, 0.100, 0.500] + 7: [ 1, 1, 1, 2.00, 20.00, 30.00, 0.050, 0.300] + 8: [ 1, 1, 1, 3.50, 40.00, 30.00, 0.050, 0.300] + 9: [ 1, 1, 1, 3.00, 20.00, 30.00, 0.050, 0.300] + 10: [ 1, 1, 1, 4.80, 25.00, 30.00, 0.050, 0.300] + 11: [ 1, 1, 1, 5.00, 30.00, 50.00, 0.050, 0.300] + 12: [ 1, 1, 1, 6.00, 30.00, 50.00, 0.050, 0.300] + 13: [ 1, 1, 1, 4.50, 30.00, 50.00, 0.050, 0.300] + 14: [ 1, -1, 1, 6.30, 20.00, 50.00, 0.050, 0.300] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_amsua_n19.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_amsua_n19.yaml new file mode 100644 index 000000000..10be79b57 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_amsua_n19.yaml @@ -0,0 +1,47 @@ +# Instrument metadata +# ------------------- +commissioned: 2009-12-15T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + x0: max + x1: max +channel_values: +# sim act bcd err errcld ermax x0 x1 + 1: [ 1, 1, 1, 2.50, 20.00, 4.50, 0.050, 0.600 ] + 2: [ 1, 1, 1, 2.20, 18.00, 4.50, 0.030, 0.450 ] + 3: [ 1, 1, 1, 2.00, 12.00, 4.50, 0.030, 0.400 ] + 4: [ 1, 1, 1, 0.55, 3.00, 2.50, 0.020, 0.450 ] + 5: [ 1, 1, 1, 0.30, 0.50, 2.00, 0.000, 1.000 ] + 6: [ 1, 1, 1, 0.23, 0.30, 2.00, 0.100, 1.500 ] + 7: [ 1, 1, 1, 0.23, 0.23, 2.00, 0.000, 0.000 ] + 8: [ 1, 1, 1, 0.25, 0.25, 2.00, 0.000, 0.000 ] + 9: [ 1, 1, 1, 0.25, 0.25, 2.00, 0.000, 0.000 ] + 10: [ 1, 1, 1, 0.35, 0.35, 2.00, 0.000, 0.000 ] + 11: [ 1, 1, 1, 0.40, 0.40, 2.50, 0.000, 0.000 ] + 12: [ 1, 1, 1, 0.55, 0.55, 3.50, 0.000, 0.000 ] + 13: [ 1, 1, 1, 0.80, 0.80, 4.50, 0.000, 0.000 ] + 14: [ 1, 1, 0, 4.00, 4.00, 4.50, 0.000, 0.000 ] # No bias correction of Ch.14 + 15: [ 1, 1, 1, 3.50, 18.00, 4.50, 0.030, 0.200 ] + +# Chronicle of changes for this instrument +# ---------------------------------------- +chronicles: + +- action_date: "2009-12-22T00:00:00" + justification: 'Ch8 noisy (noise started on 12/21/2009). Switch to monitoring only' + channel_values: + 8: [ 1, -1, 1, 0.25, 0.25, 2.00, 0.000, 0.000 ] + +- action_date: "2014-01-29T00:00:00" + justification: 'Per NCEP r35918. Ch 7 switch to monitoring only' + channel_values: + 7: [ 1, -1, 1, 0.23, 0.23, 2.00, 0.000, 0.000 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_n20.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_n20.yaml new file mode 100644 index 000000000..40f02a5d6 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_n20.yaml @@ -0,0 +1,43 @@ +# Instrument metadata +# ------------------- +commissioned: 2018-05-10T12:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 1: [ 1, 1, 1, 4.50, 20.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 2: [ 1, 1, 1, 4.50, 25.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 3: [ 1, 1, 1, 4.50, 12.00, 3.00, 10.00, 0.00, -2, 1, -1 ] + 4: [ 1, 1, 1, 2.50, 7.00, 3.00, 10.00, 0.00, -2, 1, -1 ] + 5: [ 1, 1, 1, 0.55, 3.50, 1.00, 10.00, 0.00, -2, 1, -1 ] + 6: [ 1, 1, 1, 0.30, 3.00, 1.00, 10.00, 0.00, -2, 1, -1 ] + 7: [ 1, 1, 1, 0.30, 0.80, 1.00, 10.00, 0.00, -2, 1, -1 ] + 8: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 9: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 10: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 11: [ 1, 1, 1, 0.45, 0.45, 1.00, 10.00, 0.00, -2, 1, -1 ] + 12: [ 1, 1, 1, 0.45, 0.45, 1.00, 10.00, 0.00, -2, 1, -1 ] + 13: [ 1, 1, 1, 0.55, 0.55, 1.00, 10.00, 0.00, -2, 1, -1 ] + 14: [ 1, 1, 1, 0.80, 0.80, 2.00, 10.00, 0.00, -2, 1, -1 ] + 15: [ 1, 1, 0, 4.00, 4.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 16: [ 1, 1, 1, 4.00, 19.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 17: [ 1, 1, 1, 4.00, 30.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 18: [ 1, 1, 1, 3.50, 25.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 19: [ 1, 1, 1, 3.00, 16.50, 2.00, 10.00, 0.00, -2, 1, -1 ] + 20: [ 1, 1, 1, 3.00, 12.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 21: [ 1, 1, 1, 3.00, 9.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 22: [ 1, 1, 1, 3.00, 6.50, 2.00, 10.00, 0.00, -2, 1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_n21.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_n21.yaml new file mode 100644 index 000000000..3311e650a --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_n21.yaml @@ -0,0 +1,43 @@ +# Instrument metadata +# ------------------- +commissioned: 2023-05-01T12:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 1: [ 1, 1, 1, 4.50, 20.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 2: [ 1, 1, 1, 4.50, 25.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 3: [ 1, 1, 1, 4.50, 12.00, 3.00, 10.00, 0.00, -2, 1, -1 ] + 4: [ 1, 1, 1, 2.50, 7.00, 3.00, 10.00, 0.00, -2, 1, -1 ] + 5: [ 1, 1, 1, 0.55, 3.50, 1.00, 10.00, 0.00, -2, 1, -1 ] + 6: [ 1, 1, 1, 0.30, 3.00, 1.00, 10.00, 0.00, -2, 1, -1 ] + 7: [ 1, 1, 1, 0.30, 0.80, 1.00, 10.00, 0.00, -2, 1, -1 ] + 8: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 9: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 10: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 11: [ 1, 1, 1, 0.45, 0.45, 1.00, 10.00, 0.00, -2, 1, -1 ] + 12: [ 1, 1, 1, 0.45, 0.45, 1.00, 10.00, 0.00, -2, 1, -1 ] + 13: [ 1, 1, 1, 0.55, 0.55, 1.00, 10.00, 0.00, -2, 1, -1 ] + 14: [ 1, 1, 1, 0.80, 0.80, 2.00, 10.00, 0.00, -2, 1, -1 ] + 15: [ 1, 1, 0, 4.00, 4.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 16: [ 1, 1, 1, 4.00, 19.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 17: [ 1, 1, 1, 4.00, 30.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 18: [ 1, 1, 1, 3.50, 25.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 19: [ 1, 1, 1, 3.00, 16.50, 2.00, 10.00, 0.00, -2, 1, -1 ] + 20: [ 1, 1, 1, 3.00, 12.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 21: [ 1, 1, 1, 3.00, 9.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 22: [ 1, 1, 1, 3.00, 6.50, 2.00, 10.00, 0.00, -2, 1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_npp.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_npp.yaml new file mode 100644 index 000000000..6a83f603b --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_atms_npp.yaml @@ -0,0 +1,43 @@ +# Instrument metadata +# ------------------- +commissioned: 2011-11-16T00:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 1: [ 1, 1, 1, 4.50, 20.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 2: [ 1, 1, 1, 4.50, 25.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 3: [ 1, 1, 1, 4.50, 12.00, 3.00, 10.00, 0.00, -2, 1, -1 ] + 4: [ 1, 1, 1, 2.50, 7.00, 3.00, 10.00, 0.00, -2, 1, -1 ] + 5: [ 1, 1, 1, 0.55, 3.50, 1.00, 10.00, 0.00, -2, 1, -1 ] + 6: [ 1, 1, 1, 0.30, 3.00, 1.00, 10.00, 0.00, -2, 1, -1 ] + 7: [ 1, 1, 1, 0.30, 0.80, 1.00, 10.00, 0.00, -2, 1, -1 ] + 8: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 9: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 10: [ 1, 1, 1, 0.40, 0.40, 1.00, 10.00, 0.00, -2, 1, -1 ] + 11: [ 1, 1, 1, 0.45, 0.45, 1.00, 10.00, 0.00, -2, 1, -1 ] + 12: [ 1, 1, 1, 0.45, 0.45, 1.00, 10.00, 0.00, -2, 1, -1 ] + 13: [ 1, 1, 1, 0.55, 0.55, 1.00, 10.00, 0.00, -2, 1, -1 ] + 14: [ 1, 1, 1, 0.80, 0.80, 2.00, 10.00, 0.00, -2, 1, -1 ] + 15: [ 1, 1, 0, 4.00, 4.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 16: [ 1, 1, 1, 4.00, 19.00, 4.50, 10.00, 0.00, -2, 1, -1 ] + 17: [ 1, 1, 1, 4.00, 30.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 18: [ 1, 1, 1, 3.50, 25.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 19: [ 1, 1, 1, 3.00, 16.50, 2.00, 10.00, 0.00, -2, 1, -1 ] + 20: [ 1, 1, 1, 3.00, 12.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 21: [ 1, 1, 1, 3.00, 9.00, 2.00, 10.00, 0.00, -2, 1, -1 ] + 22: [ 1, 1, 1, 3.00, 6.50, 2.00, 10.00, 0.00, -2, 1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_n20.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_n20.yaml new file mode 100644 index 000000000..a5c4ab759 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_n20.yaml @@ -0,0 +1,452 @@ +# Instrument metadata +# ------------------- +commissioned: 2018-02-17T00:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 19: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 24: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 26: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 27: [ 1, -1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 28: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 31: [ 1, -1, 1, 1.359, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 32: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 33: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 37: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 39: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 42: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 44: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 47: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 49: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 50: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 51: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 52: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 53: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 54: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 55: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 56: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 57: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 58: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 59: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 60: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 61: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 62: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 63: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 64: [ 1, -1, 1, 0.756, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 65: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 66: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 67: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 68: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 69: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 70: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 71: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 72: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 73: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 74: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 75: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 76: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 77: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 78: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 79: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 80: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 81: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 82: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 83: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 84: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 85: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 86: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 87: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 88: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 89: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 90: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 91: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 92: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 93: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 94: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 95: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 96: [ 1, -1, 1, 0.635, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 97: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 98: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 99: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 100: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 101: [ 1, -1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 102: [ 1, -1, 1, 0.735, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 103: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 104: [ 1, -1, 1, 0.878, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 105: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 106: [ 1, -1, 1, 0.696, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 107: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 108: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 109: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 110: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 111: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 113: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 114: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 115: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 116: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 117: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 118: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 119: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 120: [ 1, -1, 1, 0.701, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 121: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 122: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 123: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 124: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 125: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 126: [ 1, -1, 1, 0.663, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 127: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 129: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 130: [ 1, -1, 1, 1.083, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 131: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 132: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 133: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 134: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 135: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 136: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 137: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 138: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 139: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 141: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 142: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 143: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 144: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 145: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 146: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 147: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 148: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 149: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 150: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 151: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 152: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 153: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 154: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 155: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 156: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 157: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 158: [ 1, -1, 1, 0.773, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 159: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 161: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 162: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 163: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 164: [ 1, -1, 1, 0.813, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 165: [ 1, -1, 1, 0.907, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 166: [ 1, -1, 1, 0.802, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 167: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 168: [ 1, -1, 1, 1.493, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 169: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 170: [ 1, -1, 1, 0.856, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 171: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 173: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 174: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 175: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 176: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 177: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 178: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 179: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 180: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 181: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 183: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 184: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 185: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 186: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 187: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 188: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 190: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 191: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 192: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 193: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 194: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 195: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 196: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 197: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 198: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 199: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 200: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 208: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 211: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 216: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 224: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 234: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 236: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 238: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 239: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 242: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 246: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 248: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 255: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 264: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 266: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 268: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 275: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 279: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 283: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 285: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 291: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 295: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 301: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 305: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 311: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 332: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 342: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 389: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 400: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 402: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 404: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 406: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 410: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 427: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 439: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 440: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 441: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 445: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 449: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 455: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 458: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 461: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 464: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 467: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 470: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 475: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 482: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 486: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 487: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 490: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 493: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 496: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 501: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 503: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 505: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 511: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 513: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 514: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 518: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 519: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 520: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 522: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 529: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 534: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 563: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 568: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 575: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 592: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 594: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 598: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 600: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 604: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 611: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 614: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 616: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 618: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 620: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 622: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 626: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 631: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 638: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 646: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 648: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 652: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 659: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 673: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 675: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 678: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 684: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 688: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 694: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 700: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 707: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 710: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 713: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 714: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 718: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 720: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 722: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 725: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 728: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 735: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 742: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 748: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 753: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 762: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 780: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 784: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 798: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 849: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 860: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 862: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 866: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 874: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 882: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 890: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 898: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 906: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 907: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 908: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 914: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 937: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 988: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 995: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 998: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1000: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1003: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1008: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1009: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1010: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1014: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1017: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1018: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1020: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1022: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1024: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1026: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1029: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1030: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1032: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1034: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1037: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1038: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1041: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1042: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1044: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1046: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1049: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1050: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1053: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1054: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1058: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1060: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1062: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1064: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1066: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1069: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1076: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1077: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1080: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1086: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1091: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1095: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1101: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1109: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1121: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1133: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1163: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1187: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1205: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1211: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1219: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1231: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1245: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1271: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1289: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1300: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1313: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1316: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1325: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1329: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1346: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1347: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1474: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1491: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1570: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1619: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1624: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1635: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1939: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1940: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1941: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1942: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1943: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1944: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1945: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1946: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1947: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1948: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1949: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1950: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1951: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1952: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1953: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1954: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1955: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1956: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1957: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1958: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1959: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1960: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1961: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1962: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1963: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1964: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1965: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1966: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1967: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1968: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1969: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1970: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1971: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1974: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1975: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1976: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1977: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1979: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1982: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1983: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1984: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1985: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1986: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1987: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2119: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2143: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2147: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2153: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2158: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2161: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2168: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2171: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2175: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_n21.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_n21.yaml new file mode 100644 index 000000000..06b4c357f --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_n21.yaml @@ -0,0 +1,451 @@ +# Instrument metadata +# ------------------- +commissioned: 2023-08-17T00:00:00 # Source: https://github.com/GEOS-ESM/GEOS_mksi/blob/develop/sidb/active_channels.tbl#L1128 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 19: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 24: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 26: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 27: [ 1, -1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 28: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 31: [ 1, -1, 1, 1.359, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 32: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 33: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 37: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 39: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 42: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 44: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 47: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 49: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 50: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 51: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 52: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 53: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 54: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 55: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 56: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 57: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 58: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 59: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 60: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 61: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 62: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 63: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 64: [ 1, -1, 1, 0.756, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 65: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 66: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 67: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 68: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 69: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 70: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 71: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 72: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 73: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 74: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 75: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 76: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 77: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 78: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 79: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 80: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 81: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 82: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 83: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 84: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 85: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 86: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 87: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 88: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 89: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 90: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 91: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 92: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 93: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 94: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 95: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 96: [ 1, -1, 1, 0.635, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 97: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 98: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 99: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 100: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 101: [ 1, -1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 102: [ 1, -1, 1, 0.735, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 103: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 104: [ 1, -1, 1, 0.878, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 105: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 106: [ 1, -1, 1, 0.696, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 107: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 108: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 109: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 110: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 111: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 113: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 114: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 115: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 116: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 117: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 118: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 119: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 120: [ 1, -1, 1, 0.701, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 121: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 122: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 123: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 124: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 125: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 126: [ 1, -1, 1, 0.663, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 127: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 129: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 130: [ 1, -1, 1, 1.083, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 131: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 132: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 133: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 134: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 135: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 136: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 137: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 138: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 139: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 141: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 142: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 143: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 144: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 145: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 146: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 147: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 148: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 149: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 150: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 151: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 152: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 153: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 154: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 155: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 156: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 157: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 158: [ 1, -1, 1, 0.773, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 159: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 161: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 162: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 163: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 164: [ 1, -1, 1, 0.813, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 165: [ 1, -1, 1, 0.907, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 166: [ 1, -1, 1, 0.802, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 167: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 168: [ 1, -1, 1, 1.493, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 169: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 170: [ 1, -1, 1, 0.856, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 171: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 173: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 174: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 175: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 176: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 177: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 178: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 179: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 180: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 181: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 183: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 184: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 185: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 186: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 187: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 188: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 190: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 191: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 192: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 193: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 194: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 195: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 196: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 197: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 198: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 199: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 200: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 208: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 211: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 216: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 224: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 234: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 236: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 238: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 239: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 242: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 246: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 248: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 255: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 264: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 266: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 268: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 275: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 279: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 283: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 285: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 291: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 295: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 301: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 305: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 311: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 332: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 342: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 389: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 400: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 402: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 404: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 406: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 410: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 427: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 439: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 440: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 441: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 445: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 449: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 455: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 458: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 461: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 464: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 467: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 470: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 475: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 482: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 486: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 487: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 490: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 493: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 496: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 501: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 503: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 505: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 511: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 513: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 514: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 518: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 519: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 520: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 522: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 529: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 534: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 563: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 568: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 575: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 592: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 594: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 598: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 600: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 604: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 611: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 614: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 616: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 618: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 620: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 622: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 626: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 631: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 638: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 646: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 648: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 652: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 659: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 673: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 675: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 678: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 684: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 688: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 694: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 700: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 707: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 710: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 713: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 714: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 718: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 720: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 722: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 725: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 728: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 735: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 742: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 748: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 753: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 762: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 780: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 784: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 798: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 849: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 860: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 862: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 866: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 874: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 882: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 890: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 898: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 906: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 907: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 908: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 914: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 937: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 988: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 995: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 998: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1000: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1003: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1008: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1009: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1010: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1014: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1017: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1018: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1020: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1022: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1024: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1026: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1029: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1030: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1032: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1034: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1037: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1038: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1041: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1042: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1044: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1046: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1049: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1050: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1053: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1054: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1058: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1060: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1062: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1064: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1066: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1069: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1076: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1077: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1080: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1086: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1091: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1095: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1101: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1109: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1121: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1133: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1163: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1187: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1205: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1211: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1219: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1231: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1245: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1271: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1289: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1300: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1313: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1316: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1325: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1329: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1346: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1347: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1474: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1491: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1570: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1619: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1624: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1635: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1939: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1940: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1941: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1942: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1943: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1944: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1945: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1946: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1947: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1948: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1949: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1950: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1951: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1952: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1953: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1954: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1955: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1956: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1957: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1958: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1959: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1960: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1961: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1962: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1963: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1964: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1965: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1966: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1967: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1968: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1969: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1970: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1971: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1974: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1975: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1976: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1977: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1979: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1982: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1983: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1984: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1985: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1986: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1987: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2119: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2143: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2147: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2153: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2158: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2161: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2168: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2171: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2175: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_npp.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_npp.yaml new file mode 100644 index 000000000..26d4a0a43 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_cris-fsr_npp.yaml @@ -0,0 +1,1346 @@ +# Instrument metadata +# ------------------- +commissioned: "2018-02-12T12:00:00" +# decommissioned: 2021-05-22T00:00:00 (Effectively decommissioned since no active channels.) + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 19: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 24: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 26: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 27: [ 1, -1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 28: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 31: [ 1, -1, 1, 1.359, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 32: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 33: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 37: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 39: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 42: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 44: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 47: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 49: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 50: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 51: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 52: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 53: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 54: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 55: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 56: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 57: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 58: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 59: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 60: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 61: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 62: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 63: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 64: [ 1, -1, 1, 0.756, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 65: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 66: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 67: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 68: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 69: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 70: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 71: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 72: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 73: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 74: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 75: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 76: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 77: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 78: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 79: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 80: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 81: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 82: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 83: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 84: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 85: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 86: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 87: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 88: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 89: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 90: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 91: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 92: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 93: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 94: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 95: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 96: [ 1, -1, 1, 0.635, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 97: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 98: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 99: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 100: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 101: [ 1, -1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 102: [ 1, -1, 1, 0.735, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 103: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 104: [ 1, -1, 1, 0.878, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 105: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 106: [ 1, -1, 1, 0.696, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 107: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 108: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 109: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 110: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 111: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 113: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 114: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 115: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 116: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 117: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 118: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 119: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 120: [ 1, -1, 1, 0.701, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 121: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 122: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 123: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 124: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 125: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 126: [ 1, -1, 1, 0.663, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 127: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 129: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 130: [ 1, -1, 1, 1.083, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 131: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 132: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 133: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 134: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 135: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 136: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 137: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 138: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 139: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 141: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 142: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 143: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 144: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 145: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 146: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 147: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 148: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 149: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 150: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 151: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 152: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 153: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 154: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 155: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 156: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 157: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 158: [ 1, -1, 1, 0.773, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 159: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 161: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 162: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 163: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 164: [ 1, -1, 1, 0.813, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 165: [ 1, -1, 1, 0.907, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 166: [ 1, -1, 1, 0.802, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 167: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 168: [ 1, -1, 1, 1.493, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 169: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 170: [ 1, -1, 1, 0.856, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 171: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 173: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 174: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 175: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 176: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 177: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 178: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 179: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 180: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 181: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 183: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 184: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 185: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 186: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 187: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 188: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 190: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 191: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 192: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 193: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 194: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 195: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 196: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 197: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 198: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 199: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 200: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 208: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 211: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 216: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 224: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 234: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 236: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 238: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 239: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 242: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 246: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 248: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 255: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 264: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 266: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 268: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 275: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 279: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 283: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 285: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 291: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 295: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 301: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 305: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 311: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 332: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 342: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 389: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 400: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 402: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 404: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 406: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 410: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 427: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 439: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 440: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 441: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 445: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 449: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 455: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 458: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 461: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 464: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 467: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 470: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 475: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 482: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 486: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 487: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 490: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 493: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 496: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 501: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 503: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 505: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 511: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 513: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 514: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 518: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 519: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 520: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 522: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 529: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 534: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 563: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 568: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 575: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 592: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 594: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 598: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 600: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 604: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 611: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 614: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 616: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 618: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 620: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 622: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 626: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 631: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 638: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 646: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 648: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 652: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 659: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 673: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 675: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 678: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 684: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 688: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 694: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 700: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 707: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 710: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 713: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 714: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 718: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 720: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 722: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 725: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 728: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 735: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 742: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 748: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 753: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 762: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 780: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 784: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 798: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 849: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 860: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 862: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 866: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 874: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 882: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 890: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 898: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 906: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 907: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 908: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 914: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 937: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 988: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 995: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 998: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1000: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1003: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1008: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1009: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1010: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1014: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1017: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1018: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1020: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1022: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1024: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1026: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1029: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1030: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1032: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1034: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1037: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1038: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1041: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1042: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1044: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1046: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1049: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1050: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1053: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1054: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1058: [ 1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1060: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1062: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1064: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1066: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1069: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1076: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1077: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1080: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1086: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1091: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1095: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1101: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1109: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1121: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1133: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1163: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1187: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1205: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1211: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1219: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1231: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1245: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1271: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1289: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1300: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1313: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1316: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1325: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1329: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1346: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1347: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1474: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1491: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1570: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1619: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1624: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1635: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1939: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1940: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1941: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1942: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1943: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1944: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1945: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1946: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1947: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1948: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1949: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1950: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1951: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1952: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1953: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1954: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1955: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1956: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1957: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1958: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1959: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1960: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1961: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1962: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1963: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1964: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1965: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1966: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1967: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1968: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1969: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1970: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1971: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1974: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1975: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1976: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1977: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1979: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1982: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1983: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1984: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1985: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1986: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1987: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2119: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2143: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2147: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2153: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2158: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2161: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2168: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2171: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2175: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + + +# Chronicle of changes for this instrument +# ---------------------------------------- +chronicles: + +- action_date: "2019-03-26T00:00:00" + justification: 'The CrIS instrument on NPP developed anomalies starting on 18Z of March 27, 2019.' + adjust_variable_for_all_channels: + variables: [active] + values: [-1] + +- action_date: "2019-04-16T18:00:00" + justification: 'NPP out because of mid-wave failure 3/25/19 18z. LW/SW data returns 4/16/19 18z but mid-wave channels missing' + channel_values: + 19: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 24: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 26: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 27: [ 1, -1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 28: [ 1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 31: [ 1, -1, 1, 1.359, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 32: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 33: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 37: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 39: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 42: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 44: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 47: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 49: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 50: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 51: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 52: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 53: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 54: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 55: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 56: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 57: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 58: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 59: [ 1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 60: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 61: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 62: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 63: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 64: [ 1, -1, 1, 0.756, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 65: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 66: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 67: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 68: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 69: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 70: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 71: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 72: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 73: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 74: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 75: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 76: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 77: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 78: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 79: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 80: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 81: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 82: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 83: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 84: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 85: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 86: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 87: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 88: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 89: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 90: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 91: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 92: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 93: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 94: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 95: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 96: [ 1, -1, 1, 0.635, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 97: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 98: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 99: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 100: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 101: [ 1, -1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 102: [ 1, -1, 1, 0.735, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 103: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 104: [ 1, -1, 1, 0.878, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 105: [ 1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 106: [ 1, -1, 1, 0.696, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 107: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 108: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 109: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 110: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 111: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 113: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 114: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 115: [ 1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 116: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 117: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 118: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 119: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 120: [ 1, -1, 1, 0.701, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 121: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 122: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 123: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 124: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 125: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 126: [ 1, -1, 1, 0.663, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 127: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 129: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 130: [ 1, -1, 1, 1.083, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 131: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 132: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 133: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 134: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 135: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 136: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 137: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 138: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 139: [ 1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 141: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 142: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 143: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 144: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 145: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 146: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 147: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 148: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 149: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 150: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 151: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 152: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 153: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 154: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 155: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 156: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 157: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 158: [ 1, -1, 1, 0.773, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 159: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 161: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 162: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 163: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 164: [ 1, -1, 1, 0.813, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 165: [ 1, -1, 1, 0.907, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 166: [ 1, -1, 1, 0.802, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 167: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 168: [ 1, -1, 1, 1.493, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 169: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 170: [ 1, -1, 1, 0.856, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 171: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 173: [ 1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 174: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 175: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 176: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 177: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 178: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 179: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 180: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 181: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 183: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 184: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 185: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 186: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 187: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 188: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 190: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 191: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 192: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 193: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 194: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 195: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 196: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 197: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 198: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 199: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 200: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 208: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 211: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 216: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 224: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 234: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 236: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 238: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 239: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 242: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 246: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 248: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 255: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 264: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 266: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 268: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 275: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 279: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 283: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 285: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 291: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 295: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 301: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 305: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 311: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 332: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 342: [ 1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 389: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 400: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 402: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 404: [ 1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 406: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 410: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 427: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 439: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 440: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 441: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 445: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 449: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 455: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 458: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 461: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 464: [ 1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 467: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 470: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 475: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 482: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 486: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 487: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 490: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 493: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 496: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 501: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 503: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 505: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 511: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 513: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 514: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 518: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 519: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 520: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 522: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 529: [ 1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 534: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 563: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 568: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 575: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 592: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 594: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 598: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 600: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 604: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 611: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 614: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 616: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 618: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 620: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 622: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 626: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 631: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 638: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 646: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 648: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 652: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 659: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 673: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 675: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 678: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 684: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 688: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 694: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 700: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 707: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 710: [ 1, -1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 713: [ 1, -1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 714: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 718: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 720: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 722: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 725: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 728: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 735: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 742: [ 1, -1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 748: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 753: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 762: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 780: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 784: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 798: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 849: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 860: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 862: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 866: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 874: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 882: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 890: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 898: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 906: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 907: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 908: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 914: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 937: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 988: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 995: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 998: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1000: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1003: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1008: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1009: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1010: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1014: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1017: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1018: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1020: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1022: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1024: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1026: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1029: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1030: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1032: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1034: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1037: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1038: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1041: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1042: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1044: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1046: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1049: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1050: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1053: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1054: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1058: [ 1, -1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1060: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1062: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1064: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1066: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1069: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1076: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1077: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1080: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1086: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1091: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1095: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1101: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1109: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1112: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1121: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1128: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1133: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1163: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1172: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1187: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1189: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1205: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1211: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1219: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1231: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1245: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1271: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1289: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1300: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1313: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1316: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1325: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1329: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1346: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1347: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1473: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1474: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1491: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1499: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1570: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1596: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1602: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1619: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1624: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1635: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1939: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1940: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1941: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1942: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1943: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1944: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1945: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1946: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1947: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1948: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1949: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1950: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1951: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1952: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1953: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1954: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1955: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1956: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1957: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1958: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1959: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1960: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1961: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1962: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1963: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1964: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1965: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1966: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1967: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1968: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1969: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1970: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1971: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1972: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1973: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1974: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1975: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1976: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1977: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1978: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1979: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1980: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1981: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1982: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1983: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1984: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1985: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1986: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1987: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2119: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2140: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2143: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2147: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2153: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2158: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2161: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2168: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2171: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2175: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2182: [ 1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + +- action_date: "2019-06-24T18:00:00" + justification: 'Switch to side-2 electronics after 6/24/19 12z. Initially passive for a few days to adjust to side-2' + adjust_variable_for_all_channels: + variables: [active] + values: [-1] + +- action_date: "2019-06-26T18:00:00" + justification: 'NPP out because of mid-wave failure 3/25/19 18z. LW/SW data returns 4/16/19 18z but mid-wave channels missing' + channel_values: + 19: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 24: [1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 26: [1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 27: [1, -1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 28: [1, 1, 1, 0.700, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 31: [1, -1, 1, 1.359, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 32: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 33: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 37: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 39: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 42: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 44: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 47: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 49: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 50: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 51: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 52: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 53: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 54: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 55: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 56: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 57: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 58: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 59: [1, 1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 60: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 61: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 62: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 63: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 64: [1, -1, 1, 0.756, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 65: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 66: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 67: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 68: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 69: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 70: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 71: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 72: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 73: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 74: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 75: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 76: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 77: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 78: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 79: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 80: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 81: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 82: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 83: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 84: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 85: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 86: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 87: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 88: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 89: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 90: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 91: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 92: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 93: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 94: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 95: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 96: [1, -1, 1, 0.635, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 97: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 98: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 99: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 100: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 101: [1, -1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 102: [1, -1, 1, 0.735, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 103: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 104: [1, -1, 1, 0.878, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 105: [1, 1, 1, 0.450, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 106: [1, -1, 1, 0.696, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 107: [1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 108: [1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 109: [1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 110: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 111: [1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 112: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 113: [1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 114: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 115: [1, 1, 1, 0.400, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 116: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 117: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 118: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 119: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 120: [1, -1, 1, 0.701, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 121: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 122: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 123: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 124: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 125: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 126: [1, -1, 1, 0.663, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 127: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 128: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 129: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 130: [1, -1, 1, 1.083, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 131: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 132: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 133: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 134: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 135: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 136: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 137: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 138: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 139: [1, 1, 1, 0.350, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 140: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 141: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 142: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 143: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 144: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 145: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 146: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 147: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 148: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 149: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 150: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 151: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 152: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 153: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 154: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 155: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 156: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 157: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 158: [1, -1, 1, 0.773, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 159: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 160: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 161: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 162: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 163: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 164: [1, -1, 1, 0.813, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 165: [1, -1, 1, 0.907, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 166: [1, -1, 1, 0.802, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 167: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 168: [1, -1, 1, 1.493, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 169: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 170: [1, -1, 1, 0.856, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 171: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 172: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 173: [1, -1, 1, 0.600, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 174: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 175: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 176: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 177: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 178: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 179: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 180: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 181: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 182: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 183: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 184: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 185: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 186: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 187: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 188: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 189: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 190: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 191: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 192: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 193: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 194: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 195: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 196: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 197: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 198: [1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 199: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 200: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 208: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 211: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 216: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 224: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 234: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 236: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 238: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 239: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 242: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 246: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 248: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 255: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 264: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 266: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 268: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 275: [1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 279: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 283: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 285: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 291: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 295: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 301: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 305: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 311: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 332: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 342: [1, 1, 1, 0.300, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 389: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 400: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 402: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 404: [1, -1, 1, 2.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 406: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 410: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 427: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 439: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 440: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 441: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 445: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 449: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 455: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 458: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 461: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 464: [1, 1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 467: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 470: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 473: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 475: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 482: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 486: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 487: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 490: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 493: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 496: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 499: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 501: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 503: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 505: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 511: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 513: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 514: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 518: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 519: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 520: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 522: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 529: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 534: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 563: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 568: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 575: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 592: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 594: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 596: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 598: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 600: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 602: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 604: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 611: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 614: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 616: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 618: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 620: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 622: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 626: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 631: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 638: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 646: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 648: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 652: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 659: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 673: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 675: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 678: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 684: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 688: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 694: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 700: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 707: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 710: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 713: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, 1, -1, -1 ] + 714: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 718: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 720: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 722: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 725: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 728: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 735: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 742: [1, 1, 1, 0.500, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 748: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 753: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 762: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 780: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 784: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 798: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 849: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 860: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 862: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 866: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 874: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 882: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 890: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 898: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 906: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 907: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 908: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 914: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 937: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 972: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 973: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 978: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 980: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 981: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 988: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 995: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 998: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1000: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1003: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1008: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1009: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1010: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1014: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1017: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1018: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1020: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1022: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1024: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1026: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1029: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1030: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1032: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1034: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1037: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1038: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1041: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1042: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1044: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1046: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1049: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1050: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1053: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1054: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1058: [1, 1, 1, 1.500, 0.000, 0.900, 10.000, 0.000, -1, -1, -1 ] + 1060: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1062: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1064: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1066: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1069: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1076: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1077: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1080: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1086: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1091: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1095: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1101: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1109: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1112: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1121: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1128: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1133: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1163: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1172: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1187: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1189: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1205: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1211: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1219: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1231: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1245: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1271: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1289: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1300: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1313: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1316: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1325: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1329: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1346: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1347: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1473: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1474: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1491: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1499: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1553: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1570: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1596: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1602: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1619: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1624: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1635: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1939: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1940: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1941: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1942: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1943: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1944: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1945: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1946: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1947: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1948: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1949: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1950: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1951: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1952: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1953: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1954: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1955: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1956: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1957: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1958: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1959: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1960: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1961: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1962: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1963: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1964: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1965: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1966: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1967: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1968: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1969: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1970: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1971: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1972: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1973: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1974: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1975: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1976: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1977: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1978: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1979: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1980: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1981: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1982: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1983: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1984: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1985: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1986: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 1987: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2119: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2140: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2143: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2147: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2153: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2158: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2161: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2168: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2171: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2175: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + 2182: [1, -1, 1, 1.000, 0.000, 2.000, 10.000, 0.000, -1, -1, -1 ] + +- action_date: "2021-05-22T18:00:00" + justification: 'Side 2 long-wave failure. Never turned back on for GFS.' + adjust_variable_for_all_channels: + variables: [active] + values: [-1] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_gmi_gpm.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_gmi_gpm.yaml new file mode 100644 index 000000000..19ff597a4 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_gmi_gpm.yaml @@ -0,0 +1,33 @@ +# Instrument metadata +# ------------------- +commissioned: 2014-04-01T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + error_cld1: max + ermax: max + x0: max + x1: max + x2: max +channel_values: +# sim act bcd err errcld errcl1 ermax x0 x1 x2 + 1: [ 1, 1, 1, 2.70, 14.00, 6.00, 30.00, 0.050, 0.200, 0.500] + 2: [ 1, 1, 1, 3.70, 15.00, 7.00, 30.00, 0.050, 0.200, 0.500] + 3: [ 1, 1, 1, 3.50, 10.00, 7.00, 15.00, 0.050, 0.200, 0.500] + 4: [ 1, 1, 1, 4.50, 20.00, 16.00, 30.00, 0.050, 0.200, 0.500] + 5: [ 1, 1, 1, 4.00, 9.00, 7.00, 15.00, 0.050, 0.200, 0.500] + 6: [ 1, 1, 1, 3.80, 16.00, 13.00, 30.00, 0.050, 0.200, 0.500] + 7: [ 1, 1, 1, 20.00, 40.00, 23.00, 15.00, 0.050, 0.200, 0.500] + 8: [ 1, 1, 1, 5.00, 10.00, 10.00, 15.00, 0.050, 0.200, 0.500] + 9: [ 1, 1, 1, 11.50, 13.00, 12.00, 20.00, 0.050, 0.200, 0.500] + 10: [ 1, 1, 1, 5.00, 12.00, 8.00, 20.00, 0.050, 0.300, 0.500] + 11: [ 1, 1, 1, 5.00, 12.00, 8.00, 20.00, 0.050, 0.200, 0.500] + 12: [ 1, 1, 1, 2.50, 8.00, 4.00, 10.00, 0.050, 0.300, 0.500] + 13: [ 1, 1, 1, 3.00, 8.00, 7.00, 10.00, 0.050, 0.300, 0.500] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-a.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-a.yaml new file mode 100644 index 000000000..90dc0d74b --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-a.yaml @@ -0,0 +1,638 @@ +# Instrument metadata +# ------------------- +commissioned: 2008-08-01T00:00:00 +decommissioned: 2021-09-08T06:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 16: [ 1, -1, 1, 1.38, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 29: [ 1, -1, 1, 0.81, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 32: [ 1, -1, 1, 0.75, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 35: [ 1, -1, 1, 0.79, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 38: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 41: [ 1, -1, 1, 0.74, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 44: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 47: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 49: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 50: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 51: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 53: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 55: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 56: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 57: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 59: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 61: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 62: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 63: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 66: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 68: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 70: [ 1, -1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 72: [ 1, -1, 1, 1.22, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 74: [ 1, -1, 1, 0.78, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 76: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 78: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 79: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 81: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 82: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 83: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 84: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 85: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 86: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 87: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 89: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 92: [ 1, -1, 1, 4.38, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 93: [ 1, -1, 1, 3.05, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 95: [ 1, -1, 1, 2.31, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 97: [ 1, -1, 1, 1.56, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 99: [ 1, -1, 1, 1.33, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 101: [ 1, -1, 1, 1.58, 0.00, 3.50, 10.00, 0.00, -1, -1, -1 ] + 103: [ 1, -1, 1, 0.93, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 104: [ 1, -1, 1, 1.67, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 106: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 109: [ 1, -1, 1, 0.57, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 110: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 111: [ 1, -1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 113: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 116: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 119: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 122: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 125: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 128: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 131: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 133: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 135: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 138: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 141: [ 1, -1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 144: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 146: [ 1, -1, 1, 0.50, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 148: [ 1, -1, 1, 0.82, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 150: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 151: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 154: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 157: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 159: [ 1, -1, 1, 0.52, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 161: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 163: [ 1, -1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 167: [ 1, -1, 1, 0.52, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 170: [ 1, -1, 1, 0.57, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 173: [ 1, -1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 176: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 179: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 180: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 185: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 187: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 191: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 193: [ 1, -1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 197: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 199: [ 1, -1, 1, 1.05, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 200: [ 1, -1, 1, 0.75, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 202: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 203: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 205: [ 1, -1, 1, 1.30, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 207: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 210: [ 1, -1, 1, 0.93, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 212: [ 1, -1, 1, 1.49, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 213: [ 1, -1, 1, 1.12, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 214: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 217: [ 1, -1, 1, 0.66, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 218: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 219: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 222: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 224: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 225: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 226: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 228: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 230: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 231: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 232: [ 1, -1, 1, 0.66, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 236: [ 1, -1, 1, 0.79, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 237: [ 1, -1, 1, 0.78, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 239: [ 1, -1, 1, 0.74, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 243: [ 1, -1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 246: [ 1, -1, 1, 0.77, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 249: [ 1, -1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 252: [ 1, -1, 1, 0.86, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 254: [ 1, -1, 1, 1.00, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 259: [ 1, -1, 1, 0.87, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 260: [ 1, -1, 1, 0.85, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 262: [ 1, -1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 265: [ 1, -1, 1, 0.84, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 267: [ 1, -1, 1, 0.84, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 269: [ 1, -1, 1, 0.84, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 275: [ 1, -1, 1, 0.80, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 279: [ 1, -1, 1, 0.80, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 282: [ 1, -1, 1, 0.87, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 285: [ 1, -1, 1, 0.98, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 294: [ 1, -1, 1, 0.52, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 296: [ 1, -1, 1, 0.65, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 299: [ 1, -1, 1, 0.69, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 300: [ 1, -1, 1, 0.61, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 303: [ 1, -1, 1, 0.60, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 306: [ 1, -1, 1, 0.67, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 309: [ 1, -1, 1, 0.79, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 313: [ 1, -1, 1, 0.62, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 320: [ 1, -1, 1, 0.66, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 323: [ 1, -1, 1, 0.70, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 326: [ 1, -1, 1, 0.65, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 327: [ 1, -1, 1, 0.62, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 329: [ 1, -1, 1, 0.61, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 332: [ 1, -1, 1, 0.62, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 335: [ 1, -1, 1, 0.53, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 345: [ 1, -1, 1, 0.60, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 347: [ 1, -1, 1, 0.68, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 350: [ 1, -1, 1, 0.95, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 354: [ 1, -1, 1, 0.63, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 356: [ 1, -1, 1, 0.97, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 360: [ 1, -1, 1, 0.65, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 363: [ 1, -1, 1, 0.98, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 366: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 371: [ 1, -1, 1, 0.73, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 372: [ 1, -1, 1, 0.65, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 373: [ 1, -1, 1, 0.85, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 375: [ 1, -1, 1, 0.99, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 377: [ 1, -1, 1, 0.76, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 379: [ 1, -1, 1, 0.85, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 381: [ 1, -1, 1, 0.97, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 383: [ 1, -1, 1, 0.77, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 386: [ 1, -1, 1, 0.62, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 389: [ 1, -1, 1, 0.63, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 398: [ 1, -1, 1, 1.21, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 401: [ 1, -1, 1, 1.41, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 404: [ 1, -1, 1, 1.55, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 405: [ 1, -1, 1, 1.78, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 407: [ 1, -1, 1, 1.35, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 408: [ 1, -1, 1, 1.14, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 410: [ 1, -1, 1, 1.69, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 411: [ 1, -1, 1, 1.79, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 414: [ 1, -1, 1, 1.46, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 416: [ 1, -1, 1, 1.63, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 418: [ 1, -1, 1, 1.94, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 423: [ 1, -1, 1, 2.01, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 426: [ 1, -1, 1, 1.24, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 428: [ 1, -1, 1, 1.76, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 432: [ 1, -1, 1, 1.26, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 433: [ 1, -1, 1, 1.47, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 434: [ 1, -1, 1, 1.90, 0.00, 5.50, 10.00, 0.00, 1, -1, -1 ] + 439: [ 1, -1, 1, 1.66, 0.00, 5.50, 10.00, 0.00, 1, -1, -1 ] + 442: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 445: [ 1, -1, 1, 1.49, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 450: [ 1, -1, 1, 1.52, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 457: [ 1, -1, 1, 1.55, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 459: [ 1, -1, 1, 1.96, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 472: [ 1, -1, 1, 2.31, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 477: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 483: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 509: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 515: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 546: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 552: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 559: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 566: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 571: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 573: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 578: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 584: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 594: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 625: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 646: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 662: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 668: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 705: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 739: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 756: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 797: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 867: [ 1, -1, 1, 2.30, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 906: [ 1, -1, 1, 2.15, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 921: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1027: [ 1, -1, 1, 2.37, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1046: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1090: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1098: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1121: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1133: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1173: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1191: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1194: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1222: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1271: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1283: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1338: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1409: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1414: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1420: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1424: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1427: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1430: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1434: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1440: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1442: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1445: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1450: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1454: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1460: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1463: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1469: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1474: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1479: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1483: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1487: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1494: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1496: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1502: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1505: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1509: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1510: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1513: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1518: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1521: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1526: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1529: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1532: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1536: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1537: [ 1, -1, 1, 2.01, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1541: [ 1, -1, 1, 2.05, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1545: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1548: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1560: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1568: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1574: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1579: [ 1, -1, 1, 1.70, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1583: [ 1, -1, 1, 1.76, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1585: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1587: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1606: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1626: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1639: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1643: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1652: [ 1, -1, 1, 2.07, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1658: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1659: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1666: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1671: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1675: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1681: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1694: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1697: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1710: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1786: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1791: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1805: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1839: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1884: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1913: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1946: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1947: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1991: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2019: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2094: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2119: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2213: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2239: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2271: [ 1, -1, 1, 1.67, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2289: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2321: [ 1, -1, 1, 1.72, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2333: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2346: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2349: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2352: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2359: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2367: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2374: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2398: [ 1, -1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2426: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2562: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2701: [ 1, -1, 1, 1.67, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2741: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2745: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2760: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2819: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2889: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2907: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2910: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2919: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2921: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2939: [ 1, -1, 1, 1.71, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2944: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2945: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2948: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2951: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2958: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2971: [ 1, -1, 1, 1.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2977: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2985: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2988: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2990: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2991: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2993: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3002: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3008: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3014: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3027: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3029: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3030: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3036: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3047: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3049: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3052: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3053: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3055: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3058: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3064: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3069: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3087: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3093: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3098: [ 1, -1, 1, 1.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3105: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3107: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3110: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3116: [ 1, -1, 1, 1.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3127: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3129: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3136: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3146: [ 1, -1, 1, 1.97, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3151: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3160: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3165: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3168: [ 1, -1, 1, 1.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3175: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3178: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3189: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3207: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3228: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3244: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3248: [ 1, -1, 1, 1.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3252: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3256: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3263: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3281: [ 1, -1, 1, 1.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3295: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3303: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3309: [ 1, -1, 1, 1.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3312: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3322: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3326: [ 1, -1, 1, 1.36, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3354: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3366: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3375: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3378: [ 1, -1, 1, 1.68, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3411: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3416: [ 1, -1, 1, 1.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3432: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3438: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3440: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3442: [ 1, -1, 1, 1.41, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 3444: [ 1, -1, 1, 1.16, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3446: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3448: [ 1, -1, 1, 1.25, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3450: [ 1, -1, 1, 1.20, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3452: [ 1, -1, 1, 1.65, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3454: [ 1, -1, 1, 1.66, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3458: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3467: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3476: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3484: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3491: [ 1, -1, 1, 1.25, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3497: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3499: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3504: [ 1, -1, 1, 1.70, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3506: [ 1, -1, 1, 0.99, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 3509: [ 1, -1, 1, 1.81, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3518: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3527: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3555: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3575: [ 1, -1, 1, 1.47, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3577: [ 1, -1, 1, 1.15, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3580: [ 1, -1, 1, 1.58, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3582: [ 1, -1, 1, 1.18, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3586: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3589: [ 1, -1, 1, 1.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3599: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3610: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3626: [ 1, -1, 1, 1.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3638: [ 1, -1, 1, 1.27, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3646: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3653: [ 1, -1, 1, 1.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3658: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3661: [ 1, -1, 1, 1.29, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3673: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3689: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3700: [ 1, -1, 1, 1.23, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3710: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3726: [ 1, -1, 1, 1.21, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3763: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3814: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3841: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3888: [ 1, -1, 1, 1.33, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 4032: [ 1, -1, 1, 1.75, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4059: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4068: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4082: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4095: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4160: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4234: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4257: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4411: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4498: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4520: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4552: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4567: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4608: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4646: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4698: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4808: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4849: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4920: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4939: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4947: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4967: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4991: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4996: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5015: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5028: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5056: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5128: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5130: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5144: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5170: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5178: [ 1, -1, 1, 1.79, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5183: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5188: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5191: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5368: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5371: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5379: [ 1, -1, 1, 1.81, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5381: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5383: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5397: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5399: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5401: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5403: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5405: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5446: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5455: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5472: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5480: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5483: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5485: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5492: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5497: [ 1, -1, 1, 1.75, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5502: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5507: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5509: [ 1, -1, 1, 2.14, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5517: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5528: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5558: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5697: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5714: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5749: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5766: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5785: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5798: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5799: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5801: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5817: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5833: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5834: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5836: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5849: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5851: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5852: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5865: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5869: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5881: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5884: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5897: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5900: [ 1, -1, 1, 2.36, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5916: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5932: [ 1, -1, 1, 2.35, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5948: [ 1, -1, 1, 2.30, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5963: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5968: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5978: [ 1, -1, 1, 2.05, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5988: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5992: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5994: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5997: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6003: [ 1, -1, 1, 1.97, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6008: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6023: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6026: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6039: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6053: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6056: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6067: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6071: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6082: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6085: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6098: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6112: [ 1, -1, 1, 2.34, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6126: [ 1, -1, 1, 9.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6135: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6140: [ 1, -1, 1, 2.38, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6149: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6154: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6158: [ 1, -1, 1, 2.39, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6161: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6168: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6174: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6182: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6187: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6205: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6209: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6213: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6317: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6339: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6342: [ 1, -1, 1, 1.54, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6366: [ 1, -1, 1, 1.64, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6381: [ 1, -1, 1, 1.51, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6391: [ 1, -1, 1, 1.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6489: [ 1, -1, 1, 2.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6962: [ 1, -1, 1, 2.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6966: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6970: [ 1, -1, 1, 2.37, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6975: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6977: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6982: [ 1, -1, 1, 1.72, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6985: [ 1, -1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6987: [ 1, -1, 1, 1.79, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6989: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6991: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6993: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6995: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6997: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6999: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7000: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7004: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7008: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7013: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7016: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7021: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7024: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7027: [ 1, -1, 1, 2.39, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7029: [ 1, -1, 1, 2.38, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7032: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7038: [ 1, -1, 1, 2.42, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7043: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7046: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7049: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7069: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7072: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7076: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7081: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7084: [ 1, -1, 1, 2.44, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7089: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7099: [ 1, -1, 1, 2.42, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7209: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7222: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7231: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7235: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7247: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7267: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7269: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7284: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7389: [ 1, -1, 1, 2.51, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7419: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7423: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7424: [ 1, -1, 1, 2.53, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7426: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7428: [ 1, -1, 1, 2.49, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7431: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7436: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7444: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7475: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7549: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7584: [ 1, -1, 1, 2.54, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7665: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7666: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7831: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7836: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7853: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7865: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7885: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7888: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7912: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7950: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7972: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7980: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7995: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8007: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8015: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8055: [ 1, -1, 1, 2.53, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8078: [ 1, -1, 1, 9.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-b.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-b.yaml new file mode 100644 index 000000000..fc255a915 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-b.yaml @@ -0,0 +1,637 @@ +# Instrument metadata +# ------------------- +commissioned: 2013-07-31T18:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 16: [ 1, 1, 1, 1.38, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 29: [ 1, -1, 1, 0.81, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 32: [ 1, -1, 1, 0.75, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 35: [ 1, -1, 1, 0.79, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 38: [ 1, 1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 41: [ 1, -1, 1, 0.74, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 44: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 47: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 49: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 50: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 51: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 53: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 55: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 56: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 57: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 59: [ 1, 1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 61: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 62: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 63: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 66: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 68: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 70: [ 1, 1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 72: [ 1, 1, 1, 1.22, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 74: [ 1, 1, 1, 0.78, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 76: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 78: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 79: [ 1, 1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 81: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 82: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 83: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 84: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 85: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 86: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 87: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 89: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 92: [ 1, -1, 1, 4.38, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 93: [ 1, -1, 1, 3.05, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 95: [ 1, -1, 1, 2.31, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 97: [ 1, -1, 1, 1.56, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 99: [ 1, -1, 1, 1.33, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 101: [ 1, -1, 1, 1.58, 0.00, 3.50, 10.00, 0.00, -1, -1, -1 ] + 103: [ 1, -1, 1, 0.93, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 104: [ 1, 1, 1, 1.67, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 106: [ 1, 1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 109: [ 1, 1, 1, 0.57, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 110: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 111: [ 1, 1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 113: [ 1, 1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 116: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 119: [ 1, 1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 122: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 125: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 128: [ 1, 1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 131: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 133: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 135: [ 1, 1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 138: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 141: [ 1, 1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 144: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 146: [ 1, 1, 1, 0.50, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 148: [ 1, 1, 1, 0.82, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 150: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 151: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 154: [ 1, 1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 157: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 159: [ 1, 1, 1, 0.52, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 161: [ 1, 1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 163: [ 1, 1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 167: [ 1, 1, 1, 0.52, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 170: [ 1, 1, 1, 0.57, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 173: [ 1, 1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 176: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 179: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 180: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 185: [ 1, 1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 187: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 191: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 193: [ 1, 1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 197: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 199: [ 1, 1, 1, 1.05, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 200: [ 1, -1, 1, 0.75, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 202: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 203: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 205: [ 1, 1, 1, 1.30, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 207: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 210: [ 1, 1, 1, 0.93, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 212: [ 1, 1, 1, 1.49, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 213: [ 1, -1, 1, 1.12, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 214: [ 1, 1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 217: [ 1, 1, 1, 0.66, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 218: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 219: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 222: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 224: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 225: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 226: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 228: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 230: [ 1, 1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 231: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 232: [ 1, 1, 1, 0.66, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 236: [ 1, 1, 1, 0.79, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 237: [ 1, -1, 1, 0.78, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 239: [ 1, 1, 1, 0.74, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 243: [ 1, 1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 246: [ 1, 1, 1, 0.77, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 249: [ 1, 1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 252: [ 1, 1, 1, 0.86, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 254: [ 1, 1, 1, 1.00, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 259: [ 1, -1, 1, 0.87, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 260: [ 1, 1, 1, 0.85, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 262: [ 1, 1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 265: [ 1, 1, 1, 0.84, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 267: [ 1, 1, 1, 0.84, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 269: [ 1, -1, 1, 0.84, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 275: [ 1, 1, 1, 0.80, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 279: [ 1, -1, 1, 0.80, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 282: [ 1, 1, 1, 0.87, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 285: [ 1, -1, 1, 0.98, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 294: [ 1, 1, 1, 0.52, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 296: [ 1, 1, 1, 0.65, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 299: [ 1, 1, 1, 0.69, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 300: [ 1, -1, 1, 0.61, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 303: [ 1, 1, 1, 0.60, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 306: [ 1, 1, 1, 0.67, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 309: [ 1, -1, 1, 0.79, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 313: [ 1, -1, 1, 0.62, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 320: [ 1, -1, 1, 0.66, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 323: [ 1, 1, 1, 0.70, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 326: [ 1, -1, 1, 0.65, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 327: [ 1, 1, 1, 0.62, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 329: [ 1, 1, 1, 0.61, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 332: [ 1, -1, 1, 0.62, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 335: [ 1, 1, 1, 0.53, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 345: [ 1, 1, 1, 0.60, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 347: [ 1, 1, 1, 0.68, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 350: [ 1, 1, 1, 0.95, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 354: [ 1, 1, 1, 0.63, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 356: [ 1, 1, 1, 0.97, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 360: [ 1, 1, 1, 0.65, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 363: [ 1, -1, 1, 0.98, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 366: [ 1, 1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 371: [ 1, 1, 1, 0.73, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 372: [ 1, -1, 1, 0.65, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 373: [ 1, 1, 1, 0.85, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 375: [ 1, 1, 1, 0.99, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 377: [ 1, 1, 1, 0.76, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 379: [ 1, 1, 1, 0.85, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 381: [ 1, 1, 1, 0.97, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 383: [ 1, 1, 1, 0.77, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 386: [ 1, 1, 1, 0.62, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 389: [ 1, 1, 1, 0.63, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 398: [ 1, 1, 1, 1.21, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 401: [ 1, 1, 1, 1.41, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 404: [ 1, 1, 1, 1.55, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 405: [ 1, -1, 1, 1.78, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 407: [ 1, 1, 1, 1.35, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 408: [ 1, -1, 1, 1.14, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 410: [ 1, 1, 1, 1.69, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 411: [ 1, -1, 1, 1.79, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 414: [ 1, 1, 1, 1.46, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 416: [ 1, 1, 1, 1.63, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 418: [ 1, -1, 1, 1.94, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 423: [ 1, -1, 1, 2.01, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 426: [ 1, 1, 1, 1.24, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 428: [ 1, 1, 1, 1.76, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 432: [ 1, 1, 1, 1.26, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 433: [ 1, -1, 1, 1.47, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 434: [ 1, 1, 1, 1.90, 0.00, 5.50, 10.00, 0.00, 1, -1, -1 ] + 439: [ 1, 1, 1, 1.66, 0.00, 5.50, 10.00, 0.00, 1, -1, -1 ] + 442: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 445: [ 1, 1, 1, 1.49, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 450: [ 1, -1, 1, 1.52, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 457: [ 1, 1, 1, 1.55, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 459: [ 1, -1, 1, 1.96, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 472: [ 1, -1, 1, 2.31, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 477: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 483: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 509: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 515: [ 1, 1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 546: [ 1, 1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 552: [ 1, 1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 559: [ 1, 1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 566: [ 1, 1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 571: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 573: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 578: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 584: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 594: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 625: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 646: [ 1, 1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 662: [ 1, 1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 668: [ 1, 1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 705: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 739: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 756: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 797: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 867: [ 1, 1, 1, 2.30, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 906: [ 1, 1, 1, 2.15, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 921: [ 1, 1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1027: [ 1, 1, 1, 2.37, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1046: [ 1, 1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1090: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1098: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1121: [ 1, 1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1133: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1173: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1191: [ 1, 1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1194: [ 1, 1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1222: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1271: [ 1, 1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1283: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1338: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1409: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1414: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1420: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1424: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1427: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1430: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1434: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1440: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1442: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1445: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1450: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1454: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1460: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1463: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1469: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1474: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1479: [ 1, 1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1483: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1487: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1494: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1496: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1502: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1505: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1509: [ 1, 1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1510: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1513: [ 1, 1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1518: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1521: [ 1, 1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1526: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1529: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1532: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1536: [ 1, 1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1537: [ 1, -1, 1, 2.01, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1541: [ 1, -1, 1, 2.05, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1545: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1548: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1560: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1568: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1574: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1579: [ 1, 1, 1, 1.70, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1583: [ 1, -1, 1, 1.76, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1585: [ 1, 1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1587: [ 1, 1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1606: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1626: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1639: [ 1, 1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1643: [ 1, 1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1652: [ 1, 1, 1, 2.07, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1658: [ 1, 1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1659: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1666: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1671: [ 1, 1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1675: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1681: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1694: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1697: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1710: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1786: [ 1, 1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1791: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1805: [ 1, 1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1839: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1884: [ 1, 1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1913: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1946: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1947: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1991: [ 1, 1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2019: [ 1, 1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2094: [ 1, 1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2119: [ 1, 1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2213: [ 1, 1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2239: [ 1, 1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2271: [ 1, 1, 1, 1.67, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2289: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2321: [ 1, 1, 1, 1.72, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2333: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2346: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2349: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2352: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2359: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2367: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2374: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2398: [ 1, 1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2426: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2562: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2701: [ 1, 1, 1, 1.67, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2741: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2745: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2760: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2819: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2889: [ 1, 1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2907: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2910: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2919: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2921: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2939: [ 1, -1, 1, 1.71, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2944: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2945: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2948: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2951: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2958: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2971: [ 1, -1, 1, 1.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2977: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2985: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2988: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2990: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2991: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2993: [ 1, 1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3002: [ 1, 1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3008: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3014: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3027: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3029: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3030: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3036: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3047: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3049: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3052: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3053: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3055: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3058: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3064: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3069: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3087: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3093: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3098: [ 1, -1, 1, 1.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3105: [ 1, 1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3107: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3110: [ 1, 1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3116: [ 1, -1, 1, 1.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3127: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3129: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3136: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3146: [ 1, -1, 1, 1.97, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3151: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3160: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3165: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3168: [ 1, -1, 1, 1.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3175: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3178: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3189: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3207: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3228: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3244: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3248: [ 1, -1, 1, 1.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3252: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3256: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3263: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3281: [ 1, -1, 1, 1.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3295: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3303: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3309: [ 1, -1, 1, 1.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3312: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3322: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3326: [ 1, -1, 1, 1.36, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3354: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3366: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3375: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3378: [ 1, -1, 1, 1.68, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3411: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3416: [ 1, -1, 1, 1.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3432: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3438: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3440: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3442: [ 1, -1, 1, 1.41, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 3444: [ 1, -1, 1, 1.16, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3446: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3448: [ 1, -1, 1, 1.25, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3450: [ 1, -1, 1, 1.20, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3452: [ 1, -1, 1, 1.65, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3454: [ 1, -1, 1, 1.66, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3458: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3467: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3476: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3484: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3491: [ 1, -1, 1, 1.25, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3497: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3499: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3504: [ 1, -1, 1, 1.70, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3506: [ 1, -1, 1, 0.99, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 3509: [ 1, -1, 1, 1.81, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3518: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3527: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3555: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3575: [ 1, -1, 1, 1.47, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3577: [ 1, -1, 1, 1.15, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3580: [ 1, -1, 1, 1.58, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3582: [ 1, -1, 1, 1.18, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3586: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3589: [ 1, -1, 1, 1.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3599: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3610: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3626: [ 1, -1, 1, 1.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3638: [ 1, -1, 1, 1.27, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3646: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3653: [ 1, -1, 1, 1.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3658: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3661: [ 1, -1, 1, 1.29, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3673: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3689: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3700: [ 1, -1, 1, 1.23, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3710: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3726: [ 1, -1, 1, 1.21, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3763: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3814: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3841: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3888: [ 1, -1, 1, 1.33, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 4032: [ 1, -1, 1, 1.75, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4059: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4068: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4082: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4095: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4160: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4234: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4257: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4411: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4498: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4520: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4552: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4567: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4608: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4646: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4698: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4808: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4849: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4920: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4939: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4947: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4967: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4991: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4996: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5015: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5028: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5056: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5128: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5130: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5144: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5170: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5178: [ 1, -1, 1, 1.79, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5183: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5188: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5191: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5368: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5371: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5379: [ 1, -1, 1, 1.81, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5381: [ 1, 1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5383: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5397: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5399: [ 1, 1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5401: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5403: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5405: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5446: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5455: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5472: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5480: [ 1, 1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5483: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5485: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5492: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5497: [ 1, -1, 1, 1.75, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5502: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5507: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5509: [ 1, -1, 1, 2.14, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5517: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5528: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5558: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5697: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5714: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5749: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5766: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5785: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5798: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5799: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5801: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5817: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5833: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5834: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5836: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5849: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5851: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5852: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5865: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5869: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5881: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5884: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5897: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5900: [ 1, -1, 1, 2.36, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5916: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5932: [ 1, -1, 1, 2.35, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5948: [ 1, -1, 1, 2.30, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5963: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5968: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5978: [ 1, -1, 1, 2.05, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5988: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5992: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5994: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5997: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6003: [ 1, -1, 1, 1.97, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6008: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6023: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6026: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6039: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6053: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6056: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6067: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6071: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6082: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6085: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6098: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6112: [ 1, -1, 1, 2.34, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6126: [ 1, -1, 1, 9.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6135: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6140: [ 1, -1, 1, 2.38, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6149: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6154: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6158: [ 1, -1, 1, 2.39, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6161: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6168: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6174: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6182: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6187: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6205: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6209: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6213: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6317: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6339: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6342: [ 1, -1, 1, 1.54, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6366: [ 1, -1, 1, 1.64, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6381: [ 1, -1, 1, 1.51, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6391: [ 1, -1, 1, 1.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6489: [ 1, -1, 1, 2.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6962: [ 1, -1, 1, 2.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6966: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6970: [ 1, -1, 1, 2.37, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6975: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6977: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6982: [ 1, -1, 1, 1.72, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6985: [ 1, -1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6987: [ 1, -1, 1, 1.79, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6989: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6991: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6993: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6995: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6997: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6999: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7000: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7004: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7008: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7013: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7016: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7021: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7024: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7027: [ 1, -1, 1, 2.39, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7029: [ 1, -1, 1, 2.38, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7032: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7038: [ 1, -1, 1, 2.42, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7043: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7046: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7049: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7069: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7072: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7076: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7081: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7084: [ 1, -1, 1, 2.44, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7089: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7099: [ 1, -1, 1, 2.42, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7209: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7222: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7231: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7235: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7247: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7267: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7269: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7284: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7389: [ 1, -1, 1, 2.51, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7419: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7423: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7424: [ 1, -1, 1, 2.53, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7426: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7428: [ 1, -1, 1, 2.49, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7431: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7436: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7444: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7475: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7549: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7584: [ 1, -1, 1, 2.54, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7665: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7666: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7831: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7836: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7853: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7865: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7885: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7888: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7912: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7950: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7972: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7980: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7995: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8007: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8015: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8055: [ 1, -1, 1, 2.53, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8078: [ 1, -1, 1, 9.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-c.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-c.yaml new file mode 100644 index 000000000..05ccc83a6 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_iasi_metop-c.yaml @@ -0,0 +1,637 @@ +# Instrument metadata +# ------------------- +commissioned: 2020-05-19T12:00:00 # Source: https://github.com/GEOS-ESM/GEOS_mksi/blob/develop/sidb/active_channels.tbl#L1293 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 16: [ 1, 1, 1, 1.38, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 29: [ 1, -1, 1, 0.81, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 32: [ 1, -1, 1, 0.75, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 35: [ 1, -1, 1, 0.79, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 38: [ 1, 1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 41: [ 1, -1, 1, 0.74, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 44: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 47: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 49: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 50: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 51: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 53: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 55: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 56: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 57: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 59: [ 1, 1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 61: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 62: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 63: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 66: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 68: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 70: [ 1, 1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 72: [ 1, 1, 1, 1.22, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 74: [ 1, 1, 1, 0.78, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 76: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 78: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 79: [ 1, 1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 81: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 82: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 83: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 84: [ 1, -1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 85: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 86: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 87: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 89: [ 1, -1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 92: [ 1, -1, 1, 4.38, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 93: [ 1, -1, 1, 3.05, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 95: [ 1, -1, 1, 2.31, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 97: [ 1, -1, 1, 1.56, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 99: [ 1, -1, 1, 1.33, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 101: [ 1, -1, 1, 1.58, 0.00, 3.50, 10.00, 0.00, -1, -1, -1 ] + 103: [ 1, -1, 1, 0.93, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 104: [ 1, 1, 1, 1.67, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 106: [ 1, 1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 109: [ 1, 1, 1, 0.57, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 110: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 111: [ 1, 1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 113: [ 1, 1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 116: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 119: [ 1, 1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 122: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 125: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 128: [ 1, 1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 131: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 133: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 135: [ 1, 1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 138: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 141: [ 1, 1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 144: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 146: [ 1, 1, 1, 0.50, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 148: [ 1, 1, 1, 0.82, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 150: [ 1, -1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 151: [ 1, 1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 154: [ 1, 1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 157: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 159: [ 1, 1, 1, 0.52, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 160: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 161: [ 1, 1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 163: [ 1, 1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 167: [ 1, 1, 1, 0.52, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 170: [ 1, 1, 1, 0.57, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 173: [ 1, 1, 1, 0.55, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 176: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 179: [ 1, -1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 180: [ 1, 1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 185: [ 1, 1, 1, 0.61, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 187: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 191: [ 1, -1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 193: [ 1, 1, 1, 0.76, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 197: [ 1, -1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 199: [ 1, 1, 1, 1.05, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 200: [ 1, -1, 1, 0.75, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 202: [ 1, -1, 1, 0.51, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 203: [ 1, -1, 1, 0.65, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 205: [ 1, 1, 1, 1.30, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 207: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 210: [ 1, 1, 1, 0.93, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 212: [ 1, 1, 1, 1.49, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 213: [ 1, -1, 1, 1.12, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 214: [ 1, 1, 1, 0.68, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 217: [ 1, 1, 1, 0.66, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 218: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 219: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 222: [ 1, 1, 1, 0.59, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 224: [ 1, 1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 225: [ 1, -1, 1, 0.67, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 226: [ 1, 1, 1, 0.64, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 228: [ 1, -1, 1, 0.62, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 230: [ 1, 1, 1, 0.72, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 231: [ 1, -1, 1, 0.69, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 232: [ 1, 1, 1, 0.66, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 236: [ 1, 1, 1, 0.79, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 237: [ 1, -1, 1, 0.78, 0.00, 2.00, 10.00, 0.00, -1, -1, -1 ] + 239: [ 1, 1, 1, 0.74, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 243: [ 1, 1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 246: [ 1, 1, 1, 0.77, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 249: [ 1, 1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 252: [ 1, 1, 1, 0.86, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 254: [ 1, 1, 1, 1.00, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 259: [ 1, -1, 1, 0.87, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 260: [ 1, 1, 1, 0.85, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 262: [ 1, 1, 1, 0.88, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 265: [ 1, 1, 1, 0.84, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 267: [ 1, 1, 1, 0.84, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 269: [ 1, -1, 1, 0.84, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 275: [ 1, 1, 1, 0.80, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 279: [ 1, -1, 1, 0.80, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 282: [ 1, 1, 1, 0.87, 0.00, 3.50, 10.00, 0.00, 1, -1, -1 ] + 285: [ 1, -1, 1, 0.98, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 294: [ 1, 1, 1, 0.52, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 296: [ 1, 1, 1, 0.65, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 299: [ 1, 1, 1, 0.69, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 300: [ 1, -1, 1, 0.61, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 303: [ 1, 1, 1, 0.60, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 306: [ 1, 1, 1, 0.67, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 309: [ 1, -1, 1, 0.79, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 313: [ 1, -1, 1, 0.62, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 320: [ 1, -1, 1, 0.66, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 323: [ 1, 1, 1, 0.70, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 326: [ 1, -1, 1, 0.65, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 327: [ 1, 1, 1, 0.62, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 329: [ 1, 1, 1, 0.61, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 332: [ 1, -1, 1, 0.62, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 335: [ 1, 1, 1, 0.53, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 345: [ 1, 1, 1, 0.60, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 347: [ 1, 1, 1, 0.68, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 350: [ 1, 1, 1, 0.95, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 354: [ 1, 1, 1, 0.63, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 356: [ 1, 1, 1, 0.97, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 360: [ 1, 1, 1, 0.65, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 363: [ 1, -1, 1, 0.98, 0.00, 3.00, 10.00, 0.00, -1, -1, -1 ] + 366: [ 1, 1, 1, 0.58, 0.00, 2.00, 10.00, 0.00, 1, -1, -1 ] + 371: [ 1, 1, 1, 0.73, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 372: [ 1, -1, 1, 0.65, 0.00, 2.50, 10.00, 0.00, -1, -1, -1 ] + 373: [ 1, 1, 1, 0.85, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 375: [ 1, 1, 1, 0.99, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 377: [ 1, 1, 1, 0.76, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 379: [ 1, 1, 1, 0.85, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 381: [ 1, 1, 1, 0.97, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 383: [ 1, 1, 1, 0.77, 0.00, 3.00, 10.00, 0.00, 1, -1, -1 ] + 386: [ 1, 1, 1, 0.62, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 389: [ 1, 1, 1, 0.63, 0.00, 2.50, 10.00, 0.00, 1, -1, -1 ] + 398: [ 1, 1, 1, 1.21, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 401: [ 1, 1, 1, 1.41, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 404: [ 1, 1, 1, 1.55, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 405: [ 1, -1, 1, 1.78, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 407: [ 1, 1, 1, 1.35, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 408: [ 1, -1, 1, 1.14, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 410: [ 1, 1, 1, 1.69, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 411: [ 1, -1, 1, 1.79, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 414: [ 1, 1, 1, 1.46, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 416: [ 1, 1, 1, 1.63, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 418: [ 1, -1, 1, 1.94, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 423: [ 1, -1, 1, 2.01, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 426: [ 1, 1, 1, 1.24, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 428: [ 1, 1, 1, 1.76, 0.00, 5.00, 10.00, 0.00, 1, -1, -1 ] + 432: [ 1, 1, 1, 1.26, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 433: [ 1, -1, 1, 1.47, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 434: [ 1, 1, 1, 1.90, 0.00, 5.50, 10.00, 0.00, 1, -1, -1 ] + 439: [ 1, 1, 1, 1.66, 0.00, 5.50, 10.00, 0.00, 1, -1, -1 ] + 442: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 445: [ 1, 1, 1, 1.49, 0.00, 4.50, 10.00, 0.00, 1, -1, -1 ] + 450: [ 1, -1, 1, 1.52, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 457: [ 1, 1, 1, 1.55, 0.00, 4.00, 10.00, 0.00, 1, -1, -1 ] + 459: [ 1, -1, 1, 1.96, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 472: [ 1, -1, 1, 2.31, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 477: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 483: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 509: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 515: [ 1, 1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 546: [ 1, 1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 552: [ 1, 1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 559: [ 1, 1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 566: [ 1, 1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 571: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 573: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 578: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 584: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 594: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 625: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 646: [ 1, 1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 662: [ 1, 1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 668: [ 1, 1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 705: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 739: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 756: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 797: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 867: [ 1, 1, 1, 2.30, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 906: [ 1, 1, 1, 2.15, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 921: [ 1, 1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1027: [ 1, 1, 1, 2.37, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1046: [ 1, 1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1090: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1098: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1121: [ 1, 1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1133: [ 1, 1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1173: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1191: [ 1, 1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1194: [ 1, 1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1222: [ 1, -1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1271: [ 1, 1, 1, 2.32, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1283: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1338: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1409: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1414: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1420: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1424: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1427: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1430: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1434: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1440: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1442: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1445: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1450: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1454: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1460: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1463: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1469: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1474: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1479: [ 1, 1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1483: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1487: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1494: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1496: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1502: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1505: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1509: [ 1, 1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1510: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1513: [ 1, 1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1518: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1521: [ 1, 1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1526: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1529: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1532: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1536: [ 1, 1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1537: [ 1, -1, 1, 2.01, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1541: [ 1, -1, 1, 2.05, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1545: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1548: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1553: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1560: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1568: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1574: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1579: [ 1, 1, 1, 1.70, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1583: [ 1, -1, 1, 1.76, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1585: [ 1, 1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1587: [ 1, 1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1606: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1626: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1639: [ 1, 1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1643: [ 1, 1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1652: [ 1, 1, 1, 2.07, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1658: [ 1, 1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1659: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1666: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1671: [ 1, 1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1675: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1681: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1694: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1697: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1710: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1786: [ 1, 1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1791: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1805: [ 1, 1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1839: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1884: [ 1, 1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 1913: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1946: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1947: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 1991: [ 1, 1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2019: [ 1, 1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2094: [ 1, 1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2119: [ 1, 1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2213: [ 1, 1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2239: [ 1, 1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2271: [ 1, 1, 1, 1.67, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2289: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2321: [ 1, 1, 1, 1.72, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2333: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2346: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2349: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2352: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2359: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2367: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2374: [ 1, -1, 1, 2.17, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2398: [ 1, 1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2426: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2562: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2701: [ 1, 1, 1, 1.67, 0.00, 6.00, 10.00, 0.00, 1, -1, -1 ] + 2741: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2745: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2760: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2819: [ 1, -1, 1, 1.73, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2889: [ 1, 1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2907: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2910: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2919: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2921: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2939: [ 1, -1, 1, 1.71, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2944: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2945: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2948: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2951: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2958: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2971: [ 1, -1, 1, 1.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2977: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2985: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2988: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2990: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2991: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 2993: [ 1, 1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3002: [ 1, 1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3008: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3014: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3027: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3029: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3030: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3036: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3047: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3049: [ 1, 1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3052: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3053: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3055: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3058: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3064: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3069: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3087: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3093: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3098: [ 1, -1, 1, 1.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3105: [ 1, 1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3107: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3110: [ 1, 1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3116: [ 1, -1, 1, 1.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3127: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3129: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3136: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3146: [ 1, -1, 1, 1.97, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3151: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3160: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3165: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3168: [ 1, -1, 1, 1.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3175: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3178: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3189: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3207: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3228: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3244: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3248: [ 1, -1, 1, 1.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3252: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3256: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3263: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3281: [ 1, -1, 1, 1.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3295: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3303: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3309: [ 1, -1, 1, 1.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3312: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3322: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3326: [ 1, -1, 1, 1.36, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3354: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3366: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3375: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3378: [ 1, -1, 1, 1.68, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3411: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3416: [ 1, -1, 1, 1.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3432: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3438: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3440: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3442: [ 1, -1, 1, 1.41, 0.00, 5.50, 10.00, 0.00, -1, -1, -1 ] + 3444: [ 1, -1, 1, 1.16, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3446: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3448: [ 1, -1, 1, 1.25, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3450: [ 1, -1, 1, 1.20, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3452: [ 1, -1, 1, 1.65, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3454: [ 1, -1, 1, 1.66, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3458: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3467: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3476: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3484: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3491: [ 1, -1, 1, 1.25, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3497: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3499: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3504: [ 1, -1, 1, 1.70, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3506: [ 1, -1, 1, 0.99, 0.00, 4.00, 10.00, 0.00, -1, -1, -1 ] + 3509: [ 1, -1, 1, 1.81, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3518: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3527: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3555: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3575: [ 1, -1, 1, 1.47, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3577: [ 1, -1, 1, 1.15, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3580: [ 1, -1, 1, 1.58, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3582: [ 1, -1, 1, 1.18, 0.00, 4.50, 10.00, 0.00, -1, -1, -1 ] + 3586: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3589: [ 1, -1, 1, 1.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3599: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3610: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3626: [ 1, -1, 1, 1.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3638: [ 1, -1, 1, 1.27, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3646: [ 1, -1, 1, 1.91, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3653: [ 1, -1, 1, 1.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3658: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3661: [ 1, -1, 1, 1.29, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3673: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3689: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3700: [ 1, -1, 1, 1.23, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3710: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3726: [ 1, -1, 1, 1.21, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 3763: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3814: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3841: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 3888: [ 1, -1, 1, 1.33, 0.00, 5.00, 10.00, 0.00, -1, -1, -1 ] + 4032: [ 1, -1, 1, 1.75, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4059: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4068: [ 1, -1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4082: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4095: [ 1, -1, 1, 1.83, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4160: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4234: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4257: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4411: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4498: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4520: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4552: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4567: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4608: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4646: [ 1, -1, 1, 1.95, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4698: [ 1, -1, 1, 1.99, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4808: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4849: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4920: [ 1, -1, 1, 1.96, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4939: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4947: [ 1, -1, 1, 1.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4967: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4991: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 4996: [ 1, -1, 1, 1.84, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5015: [ 1, -1, 1, 1.87, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5028: [ 1, -1, 1, 1.77, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5056: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5128: [ 1, -1, 1, 1.89, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5130: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5144: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5170: [ 1, -1, 1, 1.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5178: [ 1, -1, 1, 1.79, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5183: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5188: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5191: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5368: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5371: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5379: [ 1, -1, 1, 1.81, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5381: [ 1, 1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5383: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5397: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5399: [ 1, 1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5401: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5403: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5405: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5446: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5455: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5472: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5480: [ 1, 1, 1, 1.98, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5483: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5485: [ 1, -1, 1, 1.80, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5492: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5497: [ 1, -1, 1, 1.75, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5502: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5507: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5509: [ 1, -1, 1, 2.14, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5517: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5528: [ 1, -1, 1, 1.86, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5558: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5697: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5714: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5749: [ 1, -1, 1, 2.03, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5766: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5785: [ 1, -1, 1, 2.19, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5798: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5799: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5801: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5817: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5833: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5834: [ 1, -1, 1, 2.33, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5836: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5849: [ 1, -1, 1, 2.21, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5851: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5852: [ 1, -1, 1, 2.23, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5865: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5869: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5881: [ 1, -1, 1, 1.88, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5884: [ 1, -1, 1, 2.26, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5897: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5900: [ 1, -1, 1, 2.36, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5916: [ 1, -1, 1, 2.29, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5932: [ 1, -1, 1, 2.35, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5948: [ 1, -1, 1, 2.30, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5963: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5968: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5978: [ 1, -1, 1, 2.05, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5988: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5992: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5994: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 5997: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6003: [ 1, -1, 1, 1.97, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6008: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6023: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6026: [ 1, -1, 1, 2.25, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6039: [ 1, -1, 1, 2.31, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6053: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6056: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6067: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6071: [ 1, -1, 1, 2.24, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6082: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6085: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6098: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6112: [ 1, -1, 1, 2.34, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6126: [ 1, -1, 1, 9.32, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6135: [ 1, -1, 1, 2.28, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6140: [ 1, -1, 1, 2.38, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6149: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6154: [ 1, -1, 1, 2.27, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6158: [ 1, -1, 1, 2.39, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6161: [ 1, -1, 1, 2.11, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6168: [ 1, -1, 1, 2.09, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6174: [ 1, -1, 1, 2.10, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6182: [ 1, -1, 1, 2.06, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6187: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6205: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6209: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6213: [ 1, -1, 1, 1.93, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6317: [ 1, -1, 1, 2.02, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6339: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6342: [ 1, -1, 1, 1.54, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6366: [ 1, -1, 1, 1.64, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6381: [ 1, -1, 1, 1.51, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6391: [ 1, -1, 1, 1.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6489: [ 1, -1, 1, 2.82, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6962: [ 1, -1, 1, 2.92, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6966: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6970: [ 1, -1, 1, 2.37, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6975: [ 1, -1, 1, 1.85, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6977: [ 1, -1, 1, 1.60, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6982: [ 1, -1, 1, 1.72, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6985: [ 1, -1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6987: [ 1, -1, 1, 1.79, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6989: [ 1, -1, 1, 1.90, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6991: [ 1, -1, 1, 1.94, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6993: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6995: [ 1, -1, 1, 2.04, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6997: [ 1, -1, 1, 2.08, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 6999: [ 1, -1, 1, 2.12, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7000: [ 1, -1, 1, 2.13, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7004: [ 1, -1, 1, 2.16, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7008: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7013: [ 1, -1, 1, 2.18, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7016: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7021: [ 1, -1, 1, 2.20, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7024: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7027: [ 1, -1, 1, 2.39, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7029: [ 1, -1, 1, 2.38, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7032: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7038: [ 1, -1, 1, 2.42, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7043: [ 1, -1, 1, 2.41, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7046: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7049: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7069: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7072: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7076: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7081: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7084: [ 1, -1, 1, 2.44, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7089: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7099: [ 1, -1, 1, 2.42, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7209: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7222: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7231: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7235: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7247: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7267: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7269: [ 1, -1, 1, 2.45, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7284: [ 1, -1, 1, 2.43, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7389: [ 1, -1, 1, 2.51, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7419: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7423: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7424: [ 1, -1, 1, 2.53, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7426: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7428: [ 1, -1, 1, 2.49, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7431: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7436: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7444: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7475: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7549: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7584: [ 1, -1, 1, 2.54, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7665: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7666: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7831: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7836: [ 1, -1, 1, 2.55, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7853: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7865: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7885: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7888: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7912: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7950: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7972: [ 1, -1, 1, 2.48, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7980: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 7995: [ 1, -1, 1, 2.50, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8007: [ 1, -1, 1, 2.52, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8015: [ 1, -1, 1, 2.46, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8055: [ 1, -1, 1, 2.53, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] + 8078: [ 1, -1, 1, 9.00, 0.00, 6.00, 10.00, 0.00, -1, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_seviri_m08.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_seviri_m08.yaml new file mode 100644 index 000000000..5d7ffc59c --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_seviri_m08.yaml @@ -0,0 +1,25 @@ +# Instrument metadata +# ------------------- +commissioned: 2012-05-22T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + +channel_values: +# sim act bcd err errcld ermax + 4: [ 1, -1, -1, 1.80, 0.00, 2.00 ] + 5: [ 1, 1, -1, 2.50, 0.00, 4.00 ] + 6: [ 1, 1, -1, 2.25, 0.00, 3.50 ] + 7: [ 1, -1, -1, 1.25, 0.00, 2.00 ] + 8: [ 1, -1, -1, 1.25, 0.00, 2.00 ] + 9: [ 1, -1, -1, 1.25, 0.00, 2.00 ] + 10: [ 1, -1, -1, 1.45, 0.00, 2.00 ] + 11: [ 1, -1, -1, 1.25, 0.00, 3.00 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_seviri_m11.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_seviri_m11.yaml new file mode 100644 index 000000000..6ca54025e --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_seviri_m11.yaml @@ -0,0 +1,25 @@ +# Instrument metadata +# ------------------- +commissioned: 2019-06-12T00:00:00 +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + +channel_values: +# sim act bcd err errcld ermax + 4: [ 1, -1, -1, 0.75, 0.00, 2.00 ] + 5: [ 1, 1, -1, 2.50, 0.00, 4.00 ] + 6: [ 1, 1, -1, 2.25, 0.00, 3.50 ] + 7: [ 1, -1, -1, 1.25, 0.00, 2.00 ] + 8: [ 1, -1, -1, 1.25, 0.00, 2.00 ] + 9: [ 1, -1, -1, 0.75, 0.00, 2.00 ] + 10: [ 1, -1, -1, 0.80, 0.00, 2.00 ] + 11: [ 1, -1, -1, 1.25, 0.00, 3.00 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_ssmis_f17.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_ssmis_f17.yaml new file mode 100644 index 000000000..1d4c17a3a --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_ssmis_f17.yaml @@ -0,0 +1,45 @@ +# Instrument metadata +# ------------------- +commissioned: 2006-12-12T00:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 1: [ 1, 1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 2: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 3: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 4: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 5: [ 1, 1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 6: [ 1, 1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 7: [ 1, 1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 8: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 9: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 10: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 11: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 12: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 13: [ 1, -1, 1, 1.27, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 14: [ 1, -1, 1, 1.44, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 15: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 16: [ 1, -1, 1, 1.34, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 17: [ 1, -1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 18: [ 1, -1, 1, 3.75, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 19: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 20: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 21: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 22: [ 1, -1, 1, 6.40, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 23: [ 1, -1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 24: [ 1, 1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_ssmis_f18.yaml b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_ssmis_f18.yaml new file mode 100644 index 000000000..9babb6114 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/atmosphere/radiance_ssmis_f18.yaml @@ -0,0 +1,45 @@ +# Instrument metadata +# ------------------- +commissioned: 2009-12-15T00:00:00 + +observer_type: satellite # Type of chronicle to use + +# Instrument initial configuration +# -------------------------------- +channel_variables: + simulated: min + active: min + biascorrtd: min + error: max + error_cld: max + ermax: max + var_b: min + var_pg: min + icld_det: min + icloud: min + iaerosol: min +channel_values: + 1: [ 1, -1, 1, 1.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 2: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 3: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 4: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 5: [ 1, -1, 1, 0.50, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 6: [ 1, -1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 7: [ 1, -1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 8: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 9: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 10: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 11: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 12: [ 1, -1, 1, 2.40, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 13: [ 1, -1, 1, 1.27, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 14: [ 1, -1, 1, 1.44, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 15: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 16: [ 1, -1, 1, 1.34, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 17: [ 1, -1, 1, 1.74, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 18: [ 1, -1, 1, 3.75, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 19: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 20: [ 1, -1, 1, 3.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 21: [ 1, -1, 1, 2.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 22: [ 1, -1, 1, 6.40, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 23: [ 1, -1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] + 24: [ 1, -1, 1, 1.00, 0.00, 6.00, 10.00, 0.00, -2, -1, -1 ] diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/adpsfc_snow.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/adpsfc_snow.yaml new file mode 100644 index 000000000..cc3d8d944 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/adpsfc_snow.yaml @@ -0,0 +1,38 @@ +# Instrument metadata +# ------------------- +commissioned: 1970-01-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [71120, 71397, 71621, 71727, 71816 # from North America + , 71641, 71976, 71743, 71902 + , 10863, 16179 # from Europe for unrealistic snow presence during summer + , 40550, 40580, 40582, 40587, 40592 # from Mid East for unrealistic snow values + , 47005, 47008, 47014, 47016, 47020, 47022, 47025, 47028, 47031, 47035 # from North Korea + , 47037, 47039, 47041, 47046, 47050, 47052, 47055, 47058, 47060, 47061 + , 47065, 47067, 47068, 47069, 47070, 47069, 47070, 47075, 47090 + , 48698, 48830 # from Singapore + # Snow reports with frequent incorrect zero values and snow presence during summer from China + , 50136, 50603, 50953, 50968, 52955, 55696, 56004, 56146, 56357, 56586 # China + , 65250] # from Africa + +# Chronicle of changes for this observation type +# ---------------------------------------- +chronicles: + +- action_date: "2021-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [71120, 71397, 71727, 71816] + +- action_date: "2022-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [50136, 50603, 50953, 50968, 52955, 55696 + , 56004, 56146, 56357, 56586] + +- action_date: "2022-10-01T01:00:00" + justification: 'Add to reject these stations' + add_to_reject_list: [47095, 47098, 47101, 47102] diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/ghcn_snow.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/ghcn_snow.yaml new file mode 100644 index 000000000..20420eabd --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/ghcn_snow.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 1900-01-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/madis_snow.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/madis_snow.yaml new file mode 100644 index 000000000..3171740d6 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/madis_snow.yaml @@ -0,0 +1,15 @@ +# Instrument metadata +# ------------------- +commissioned: 2021-01-01T00:00:00 +decommissioned: 2023-05-31T18:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [BF001, BF002, BF004, BF009, BF010, BF012, BF017, BF019, BF030, BF034, BF035, BF036, BF037, BF038, BF044, BF049, BF052, BF054, BF056, BF059, BF061, BF066, BF069, BF078, BF080, BF084, BF086, BF089, BF091, BF110, BF117, BF121, BF122, BF123, BF132, BF137, BF142, BF143, BF150, BF151, BF159, BF191, BF197, BF209, BF215, BF233, BF234, BF235, BF242, BF284, BOWC1, BT007, BT008, BT116, BT117, BT119, BT128, BT140, CAAXM, CAINP, CALXV, CSNA2, FAFA2, HPN06, KESQ6, LACQ6, LPTUT, MKLA2, OHAW1, OJIM4, OKEQ6, SHDA2, TUNA2, UTRMD, WEAQ6, WINM4, XACC1] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/sfcsno.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/sfcsno.yaml new file mode 100644 index 000000000..cc3d8d944 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/sfcsno.yaml @@ -0,0 +1,38 @@ +# Instrument metadata +# ------------------- +commissioned: 1970-01-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [71120, 71397, 71621, 71727, 71816 # from North America + , 71641, 71976, 71743, 71902 + , 10863, 16179 # from Europe for unrealistic snow presence during summer + , 40550, 40580, 40582, 40587, 40592 # from Mid East for unrealistic snow values + , 47005, 47008, 47014, 47016, 47020, 47022, 47025, 47028, 47031, 47035 # from North Korea + , 47037, 47039, 47041, 47046, 47050, 47052, 47055, 47058, 47060, 47061 + , 47065, 47067, 47068, 47069, 47070, 47069, 47070, 47075, 47090 + , 48698, 48830 # from Singapore + # Snow reports with frequent incorrect zero values and snow presence during summer from China + , 50136, 50603, 50953, 50968, 52955, 55696, 56004, 56146, 56357, 56586 # China + , 65250] # from Africa + +# Chronicle of changes for this observation type +# ---------------------------------------- +chronicles: + +- action_date: "2021-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [71120, 71397, 71727, 71816] + +- action_date: "2022-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [50136, 50603, 50953, 50968, 52955, 55696 + , 56004, 56146, 56357, 56586] + +- action_date: "2022-10-01T01:00:00" + justification: 'Add to reject these stations' + add_to_reject_list: [47095, 47098, 47101, 47102] diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/snocvr.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/snocvr.yaml new file mode 100644 index 000000000..0749e56ef --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/snocvr.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2023-05-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [BFTU1, FRDN5, MWDO3, SGNN5, NUTA3, CNDA3, HBEA3, ELCN5] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/snocvr_snomad.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/snocvr_snomad.yaml new file mode 100644 index 000000000..41b3ed06c --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/snocvr_snomad.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2023-05-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t00z/snomad.yaml b/parm/jcb-gdas/observation_chronicle/snow/t00z/snomad.yaml new file mode 100644 index 000000000..9db6e445d --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t00z/snomad.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2024-11-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/adpsfc_snow.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/adpsfc_snow.yaml new file mode 100644 index 000000000..4f4ff7be9 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/adpsfc_snow.yaml @@ -0,0 +1,78 @@ +# Instrument metadata +# ------------------- +commissioned: 1970-01-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [71120, 71397, 71621, 71727, 71816 # from North America + , 71641, 71976, 71743, 71902 + , 10863, 16179 # from Europe + , 40550, 40580, 40582, 40587, 40592 # Mid East + , 47005, 47008, 47014, 47016, 47020, 47022, 47025, 47028, 47031, 47035 # from North Korea + , 47037, 47039, 47041, 47046, 47050, 47052, 47055, 47058, 47060, 47061 + , 47065, 47067, 47068, 47069, 47070, 47069, 47070, 47075, 47090 + , 48698, 48830 # from Singapore + # Snow reports with frequent incorrect zero values in 06/12/18z cycles from China + , 50136, 50353, 50468, 50557, 50564, 50603, 50658, 50745, 50756, 50774 # from China + , 50788, 50844, 50854, 50888, 50949, 50953, 50963, 50968, 50978, 50983 + , 51467, 51573, 51644, 51656, 51716, 51747, 51765, 51777, 51828, 51886 + , 52203, 52267, 52323, 52418, 52436, 52533, 52652, 52681, 52713, 52754 + , 52818, 52836, 52866, 52908, 52955, 52983, 53068, 53083, 53149, 53192 + , 53231, 53276, 53336, 53352, 53391, 53463, 53480, 53487, 53502, 53513 + , 53529, 53543, 53564, 53588, 53593, 53614, 53646, 53673, 53698, 53705 + , 53723, 53764, 53772, 53787, 53798, 53845, 53863, 53898, 53915, 53923 + , 53959, 53975, 54026, 54027, 54049, 54094, 54096, 54115, 54135, 54157 + , 54161, 54186, 54208, 54218, 54226, 54236, 54259, 54273, 54292, 54308 + , 54311, 54324, 54337, 54342, 54346, 54374, 54377, 54386, 54401, 54405 + , 54423, 54436, 54471, 54493, 54497, 54511, 54527, 54534, 54539, 54602 + , 54618, 54662, 54715, 54725, 54751, 54753, 54776, 54808, 54823, 54826 + , 54836, 54843, 54857, 54863, 54909, 54916, 54929, 55279, 55472, 55578 + , 55591, 55664, 55696, 55773, 56004, 56033, 56065, 56096, 56106, 56116 + , 56137, 56146, 56172, 56182, 56257, 56357, 56374, 56586, 56691, 57014 + , 57046, 57067, 57071, 57083, 57259, 57265, 57279, 57297, 57378, 57399 + , 57461, 57476, 57494, 57554, 57584, 57655, 57707, 57712, 57731, 57745 + , 57766, 57776, 57793, 57799, 57832, 57845, 57853, 57866, 57902, 57922 + , 58027, 58141, 58150, 58208, 58265, 58345, 58437, 58477, 58506, 58543 + , 58556, 58569, 58633, 58652, 58725, 58730, 58731, 58752 + , 65250] # from Africa + +# Chronicle of changes for this observation type +# ---------------------------------------- +chronicles: + +- action_date: "2021-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [71120, 71397, 71727, 71816] + +- action_date: "2022-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [50136 + , 50353, 50468, 50557, 50564, 50603, 50658, 50745, 50756, 50774 # from China + , 50788, 50844, 50854, 50888, 50949, 50953, 50963, 50968, 50978, 50983 + , 51467, 51573, 51644, 51656, 51716, 51747, 51765, 51777, 51828, 51886 + , 52203, 52267, 52323, 52418, 52436, 52533, 52652, 52681, 52713, 52754 + , 52818, 52836, 52866, 52908, 52955, 52983, 53068, 53083, 53149, 53192 + , 53231, 53276, 53336, 53352, 53391, 53463, 53480, 53487, 53502, 53513 + , 53529, 53543, 53564, 53588, 53593, 53614, 53646, 53673, 53698, 53705 + , 53723, 53764, 53772, 53787, 53798, 53845, 53863, 53898, 53915, 53923 + , 53959, 53975, 54026, 54027, 54049, 54094, 54096, 54115, 54135, 54157 + , 54161, 54186, 54208, 54218, 54226, 54236, 54259, 54273, 54292, 54308 + , 54311, 54324, 54337, 54342, 54346, 54374, 54377, 54386, 54401, 54405 + , 54423, 54436, 54471, 54493, 54497, 54511, 54527, 54534, 54539, 54602 + , 54618, 54662, 54715, 54725, 54751, 54753, 54776, 54808, 54823, 54826 + , 54836, 54843, 54857, 54863, 54909, 54916, 54929, 55279, 55472, 55578 + , 55591, 55664, 55696, 55773, 56004, 56033, 56065, 56096, 56106, 56116 + , 56137, 56146, 56172, 56182, 56257, 56357, 56374, 56586, 56691, 57014 + , 57046, 57067, 57071, 57083, 57259, 57265, 57279, 57297, 57378, 57399 + , 57461, 57476, 57494, 57554, 57584, 57655, 57707, 57712, 57731, 57745 + , 57766, 57776, 57793, 57799, 57832, 57845, 57853, 57866, 57902, 57922 + , 58027, 58141, 58150, 58208, 58265, 58345, 58437, 58477, 58506, 58543 + , 58556, 58569, 58633, 58652, 58725, 58730, 58731, 58752] + +- action_date: "2022-10-01T01:00:00" + justification: 'Add to reject these stations' + add_to_reject_list: [47095, 47098, 47101, 47102] diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/ghcn_snow.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/ghcn_snow.yaml new file mode 100644 index 000000000..20420eabd --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/ghcn_snow.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 1900-01-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/madis_snow.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/madis_snow.yaml new file mode 100644 index 000000000..06a7560b2 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/madis_snow.yaml @@ -0,0 +1,15 @@ +# Instrument metadata +# ------------------- +commissioned: 2021-01-01T06:00:00 +decommissioned: 2023-05-31T18:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [BF001, BF002, BF004, BF009, BF010, BF012, BF017, BF019, BF030, BF034, BF035, BF036, BF037, BF038, BF044, BF049, BF052, BF054, BF056, BF059, BF061, BF066, BF069, BF078, BF080, BF084, BF086, BF089, BF091, BF110, BF117, BF121, BF122, BF123, BF132, BF137, BF142, BF143, BF150, BF151, BF159, BF191, BF197, BF209, BF215, BF233, BF234, BF235, BF242, BF284, BOWC1, BT007, BT008, BT116, BT117, BT119, BT128, BT140, CAAXM, CAINP, CALXV, CSNA2, FAFA2, HPN06, KESQ6, LACQ6, LPTUT, MKLA2, OHAW1, OJIM4, OKEQ6, SHDA2, TUNA2, UTRMD, WEAQ6, WINM4, XACC1] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/sfcsno.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/sfcsno.yaml new file mode 100644 index 000000000..4f4ff7be9 --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/sfcsno.yaml @@ -0,0 +1,78 @@ +# Instrument metadata +# ------------------- +commissioned: 1970-01-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [71120, 71397, 71621, 71727, 71816 # from North America + , 71641, 71976, 71743, 71902 + , 10863, 16179 # from Europe + , 40550, 40580, 40582, 40587, 40592 # Mid East + , 47005, 47008, 47014, 47016, 47020, 47022, 47025, 47028, 47031, 47035 # from North Korea + , 47037, 47039, 47041, 47046, 47050, 47052, 47055, 47058, 47060, 47061 + , 47065, 47067, 47068, 47069, 47070, 47069, 47070, 47075, 47090 + , 48698, 48830 # from Singapore + # Snow reports with frequent incorrect zero values in 06/12/18z cycles from China + , 50136, 50353, 50468, 50557, 50564, 50603, 50658, 50745, 50756, 50774 # from China + , 50788, 50844, 50854, 50888, 50949, 50953, 50963, 50968, 50978, 50983 + , 51467, 51573, 51644, 51656, 51716, 51747, 51765, 51777, 51828, 51886 + , 52203, 52267, 52323, 52418, 52436, 52533, 52652, 52681, 52713, 52754 + , 52818, 52836, 52866, 52908, 52955, 52983, 53068, 53083, 53149, 53192 + , 53231, 53276, 53336, 53352, 53391, 53463, 53480, 53487, 53502, 53513 + , 53529, 53543, 53564, 53588, 53593, 53614, 53646, 53673, 53698, 53705 + , 53723, 53764, 53772, 53787, 53798, 53845, 53863, 53898, 53915, 53923 + , 53959, 53975, 54026, 54027, 54049, 54094, 54096, 54115, 54135, 54157 + , 54161, 54186, 54208, 54218, 54226, 54236, 54259, 54273, 54292, 54308 + , 54311, 54324, 54337, 54342, 54346, 54374, 54377, 54386, 54401, 54405 + , 54423, 54436, 54471, 54493, 54497, 54511, 54527, 54534, 54539, 54602 + , 54618, 54662, 54715, 54725, 54751, 54753, 54776, 54808, 54823, 54826 + , 54836, 54843, 54857, 54863, 54909, 54916, 54929, 55279, 55472, 55578 + , 55591, 55664, 55696, 55773, 56004, 56033, 56065, 56096, 56106, 56116 + , 56137, 56146, 56172, 56182, 56257, 56357, 56374, 56586, 56691, 57014 + , 57046, 57067, 57071, 57083, 57259, 57265, 57279, 57297, 57378, 57399 + , 57461, 57476, 57494, 57554, 57584, 57655, 57707, 57712, 57731, 57745 + , 57766, 57776, 57793, 57799, 57832, 57845, 57853, 57866, 57902, 57922 + , 58027, 58141, 58150, 58208, 58265, 58345, 58437, 58477, 58506, 58543 + , 58556, 58569, 58633, 58652, 58725, 58730, 58731, 58752 + , 65250] # from Africa + +# Chronicle of changes for this observation type +# ---------------------------------------- +chronicles: + +- action_date: "2021-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [71120, 71397, 71727, 71816] + +- action_date: "2022-10-01T00:00:00" + justification: 'These stations are okay from this time' + remove_from_reject_list: [50136 + , 50353, 50468, 50557, 50564, 50603, 50658, 50745, 50756, 50774 # from China + , 50788, 50844, 50854, 50888, 50949, 50953, 50963, 50968, 50978, 50983 + , 51467, 51573, 51644, 51656, 51716, 51747, 51765, 51777, 51828, 51886 + , 52203, 52267, 52323, 52418, 52436, 52533, 52652, 52681, 52713, 52754 + , 52818, 52836, 52866, 52908, 52955, 52983, 53068, 53083, 53149, 53192 + , 53231, 53276, 53336, 53352, 53391, 53463, 53480, 53487, 53502, 53513 + , 53529, 53543, 53564, 53588, 53593, 53614, 53646, 53673, 53698, 53705 + , 53723, 53764, 53772, 53787, 53798, 53845, 53863, 53898, 53915, 53923 + , 53959, 53975, 54026, 54027, 54049, 54094, 54096, 54115, 54135, 54157 + , 54161, 54186, 54208, 54218, 54226, 54236, 54259, 54273, 54292, 54308 + , 54311, 54324, 54337, 54342, 54346, 54374, 54377, 54386, 54401, 54405 + , 54423, 54436, 54471, 54493, 54497, 54511, 54527, 54534, 54539, 54602 + , 54618, 54662, 54715, 54725, 54751, 54753, 54776, 54808, 54823, 54826 + , 54836, 54843, 54857, 54863, 54909, 54916, 54929, 55279, 55472, 55578 + , 55591, 55664, 55696, 55773, 56004, 56033, 56065, 56096, 56106, 56116 + , 56137, 56146, 56172, 56182, 56257, 56357, 56374, 56586, 56691, 57014 + , 57046, 57067, 57071, 57083, 57259, 57265, 57279, 57297, 57378, 57399 + , 57461, 57476, 57494, 57554, 57584, 57655, 57707, 57712, 57731, 57745 + , 57766, 57776, 57793, 57799, 57832, 57845, 57853, 57866, 57902, 57922 + , 58027, 58141, 58150, 58208, 58265, 58345, 58437, 58477, 58506, 58543 + , 58556, 58569, 58633, 58652, 58725, 58730, 58731, 58752] + +- action_date: "2022-10-01T01:00:00" + justification: 'Add to reject these stations' + add_to_reject_list: [47095, 47098, 47101, 47102] diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/snocvr.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/snocvr.yaml new file mode 100644 index 000000000..0749e56ef --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/snocvr.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2023-05-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [BFTU1, FRDN5, MWDO3, SGNN5, NUTA3, CNDA3, HBEA3, ELCN5] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/snocvr_snomad.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/snocvr_snomad.yaml new file mode 100644 index 000000000..41b3ed06c --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/snocvr_snomad.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2023-05-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t06z/snomad.yaml b/parm/jcb-gdas/observation_chronicle/snow/t06z/snomad.yaml new file mode 100644 index 000000000..9db6e445d --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t06z/snomad.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2024-11-01T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_chronicle/snow/t12z b/parm/jcb-gdas/observation_chronicle/snow/t12z new file mode 120000 index 000000000..e490a10cf --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t12z @@ -0,0 +1 @@ +t06z \ No newline at end of file diff --git a/parm/jcb-gdas/observation_chronicle/snow/t18z b/parm/jcb-gdas/observation_chronicle/snow/t18z new file mode 120000 index 000000000..e490a10cf --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/snow/t18z @@ -0,0 +1 @@ +t06z \ No newline at end of file diff --git a/parm/jcb-gdas/observation_chronicle/soil/smap_soil.yaml b/parm/jcb-gdas/observation_chronicle/soil/smap_soil.yaml new file mode 100644 index 000000000..af70c2a9d --- /dev/null +++ b/parm/jcb-gdas/observation_chronicle/soil/smap_soil.yaml @@ -0,0 +1,14 @@ +# Instrument metadata +# ------------------- +commissioned: 2015-01-31T00:00:00 + +observer_type: conventional # Type of chronicle to use + +window_option: max + +# observation type initial configuration +# -------------------------------- +stations_to_reject: [fakelist] + +# Chronicle of changes for this observation type +# ---------------------------------------- diff --git a/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_n20.yaml.j2 b/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_n20.yaml.j2 new file mode 100644 index 000000000..efc7eeb68 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_n20.yaml.j2 @@ -0,0 +1,50 @@ +- obs space: + name: aod_n20 + obsdatain: + engine: + type: H5File + obsfile: "{{ aero_obsdatain_path }}/{{ aero_obsdatain_prefix }}{{ observation_from_jcb }}{{ aero_obsdatain_suffix }}" + simulated variables: ['aerosolOpticalDepth'] + observed variables: ['aerosolOpticalDepth'] + variables: ['aerosolOpticalDepth'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + statistics to compute: ['mean', 'count', 'RMS'] + output file: "{{ aero_obsdataout_path }}/{{ aero_obsdataout_prefix }}{{ observation_from_jcb }}{{ aero_obsdataout_suffix }}" + output ascii file: "{{ aero_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 5.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_n21.yaml.j2 b/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_n21.yaml.j2 new file mode 100644 index 000000000..b5ff3e457 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_n21.yaml.j2 @@ -0,0 +1,50 @@ +- obs space: + name: aod_n21 + obsdatain: + engine: + type: H5File + obsfile: "{{ aero_obsdatain_path }}/{{ aero_obsdatain_prefix }}{{ observation_from_jcb }}{{ aero_obsdatain_suffix }}" + simulated variables: ['aerosolOpticalDepth'] + observed variables: ['aerosolOpticalDepth'] + variables: ['aerosolOpticalDepth'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + statistics to compute: ['mean', 'count', 'RMS'] + output file: "{{ aero_obsdataout_path }}/{{ aero_obsdataout_prefix }}{{ observation_from_jcb }}{{ aero_obsdataout_suffix }}" + output ascii file: {{ aero_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt + regular grid binning: + bin size in degrees: 5.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_npp.yaml.j2 b/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_npp.yaml.j2 new file mode 100644 index 000000000..ddbe9adcf --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/aero/retrieval_aod_viirs_npp.yaml.j2 @@ -0,0 +1,50 @@ +- obs space: + name: aod_npp + obsdatain: + engine: + type: H5File + obsfile: "{{ aero_obsdatain_path }}/{{ aero_obsdatain_prefix }}{{ observation_from_jcb }}{{ aero_obsdatain_suffix }}" + simulated variables: ['aerosolOpticalDepth'] + observed variables: ['aerosolOpticalDepth'] + variables: ['aerosolOpticalDepth'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + statistics to compute: ['mean', 'count', 'RMS'] + output file: "{{ aero_obsdataout_path }}/{{ aero_obsdataout_prefix }}{{ observation_from_jcb }}{{ aero_obsdataout_suffix }}" + output ascii file: "{{ aero_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 5.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere/conventional_ps.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere/conventional_ps.yaml.j2 new file mode 100644 index 000000000..704072d5e --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere/conventional_ps.yaml.j2 @@ -0,0 +1,50 @@ +- obs space: + name: prepbufr_adpsfc + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_obsdatain_path }}/{{ atmosphere_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdatain_suffix }}" + simulated variables: ['stationPressure'] + observed variables: ['stationPressure'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ atmosphere_obsdataout_path }}/{{ atmosphere_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 1.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_adpsfc.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_adpsfc.yaml.j2 new file mode 100644 index 000000000..44cfcb445 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_adpsfc.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: prepbufr_adpsfc + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_obsdatain_path }}/{{ atmosphere_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdatain_suffix }}" + simulated variables: ['stationPressure'] + observed variables: ['stationPressure'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ atmosphere_obsdataout_path }}/{{ atmosphere_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_adpupa.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_adpupa.yaml.j2 new file mode 100644 index 000000000..c732b701b --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_adpupa.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: prepbufr_adpupa + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_obsdatain_path }}/{{ atmosphere_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdatain_suffix }}" + simulated variables: ['stationPressure'] + observed variables: ['stationPressure'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ atmosphere_obsdataout_path }}/{{ atmosphere_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_sfcshp.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_sfcshp.yaml.j2 new file mode 100644 index 000000000..9b24361c3 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere/prepbufr_sfcshp.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: prepbufr_sfcshp + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_obsdatain_path }}/{{ atmosphere_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdatain_suffix }}" + simulated variables: ['stationPressure'] + observed variables: ['stationPressure'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure'] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ atmosphere_obsdataout_path }}/{{ atmosphere_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere_gsi/aircraft_gsi.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/aircraft_gsi.yaml.j2 new file mode 100644 index 000000000..9a1f3c802 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/aircraft_gsi.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: aircraft_gsi + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_gsi_obsdatain_path }}/{{ atmosphere_gsi_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdatain_suffix }}" + simulated variables: ['airTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + observed variables: ['airTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['airTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + groups to process: ['ombg', 'oman'] + qc groups: ['GsiEffectiveQCGes', 'GsiEffectiveQCAnl'] + output file: "{{ atmosphere_gsi_obsdataout_path }}/{{ atmosphere_gsi_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_gsi_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere_gsi/atms_n20_gsi.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/atms_n20_gsi.yaml.j2 new file mode 100644 index 000000000..067b7959a --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/atms_n20_gsi.yaml.j2 @@ -0,0 +1,51 @@ +- obs space: + name: atms_n20_gsi + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_gsi_obsdatain_path }}/{{ atmosphere_gsi_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdatain_suffix }}" + simulated variables: ['brightnessTemperature'] + observed variables: ['brightnessTemperature'] + statistics to compute: ['count', 'mean', 'RMS'] + variables: ['brightnessTemperature'] + channels: [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22] + groups to process: ['ombg', 'oman'] + qc groups: ['GsiEffectiveQCGes', 'GsiEffectiveQCAnl'] + output file: "{{ atmosphere_gsi_obsdataout_path }}/{{ atmosphere_gsi_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_gsi_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sfc_gsi.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sfc_gsi.yaml.j2 new file mode 100644 index 000000000..2f6f5b7c4 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sfc_gsi.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: sfc_gsi + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_gsi_obsdatain_path }}/{{ atmosphere_gsi_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdatain_suffix }}" + simulated variables: ['stationPressure', 'airTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + observed variables: ['stationPressure', 'airTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure', 'airTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + groups to process: ['ombg', 'oman'] + qc groups: ['GsiEffectiveQCGes', 'GsiEffectiveQCAnl'] + output file: "{{ atmosphere_gsi_obsdataout_path }}/{{ atmosphere_gsi_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_gsi_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sfcship_gsi.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sfcship_gsi.yaml.j2 new file mode 100644 index 000000000..5341825be --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sfcship_gsi.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: sfcship_gsi + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_gsi_obsdatain_path }}/{{ atmosphere_gsi_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdatain_suffix }}" + simulated variables: ['stationPressure', 'airTemperature', 'virtualTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + observed variables: ['stationPressure', 'airTemperature', 'virtualTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure', 'airTemperature', 'virtualTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + groups to process: ['ombg', 'oman'] + qc groups: ['GsiEffectiveQCGes', 'GsiEffectiveQCAnl'] + output file: "{{ atmosphere_gsi_obsdataout_path }}/{{ atmosphere_gsi_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_gsi_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sondes_gsi.yaml.j2 b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sondes_gsi.yaml.j2 new file mode 100644 index 000000000..533dab478 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/atmosphere_gsi/sondes_gsi.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: sondes_gsi + obsdatain: + engine: + type: H5File + obsfile: "{{ atmosphere_gsi_obsdatain_path }}/{{ atmosphere_gsi_obsdatain_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdatain_suffix }}" + simulated variables: ['stationPressure', 'airTemperature', 'virtualTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + observed variables: ['stationPressure', 'airTemperature', 'virtualTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: ['stationPressure', 'airTemperature', 'virtualTemperature', 'specificHumidity', 'windEastward', 'windNorthward'] + groups to process: ['ombg', 'oman'] + qc groups: ['GsiEffectiveQCGes', 'GsiEffectiveQCAnl'] + output file: "{{ atmosphere_gsi_obsdataout_path }}/{{ atmosphere_gsi_obsdataout_prefix }}{{ observation_from_jcb }}{{ atmosphere_gsi_obsdataout_suffix }}" + output ascii file: "{{ atmosphere_gsi_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + ascii vertical bins: + vertical bin names: [1000+, 1000-900, 900-800, 800-600, 600-400, 400-300, 300-250, 250-200, 200-150, 150-100, 100-50] + vertical bin ranges: [100000, 90000, 80000, 60000, 40000, 30000, 25000, 20000, 15000, 10000, 5000] + vertical bin variable: pressure + regular grid binning: + bin size in degrees: 2.5 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-66] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] diff --git a/parm/jcb-gdas/observation_statistics/snow/ims_snow.yaml.j2 b/parm/jcb-gdas/observation_statistics/snow/ims_snow.yaml.j2 new file mode 100644 index 000000000..7f584d785 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/snow/ims_snow.yaml.j2 @@ -0,0 +1,69 @@ +- obs space: + name: ims_snow + obsdatain: + engine: + type: H5File + obsfile: "{{ snow_obsdatain_path }}/{{ snow_obsdatain_prefix }}{{ observation_from_jcb }}{{ snow_obsdatain_suffix }}" + simulated variables: ['totalSnowDepth'] + observed variables: ['totalSnowDepth'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: [totalSnowDepth] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ snow_obsdataout_path }}/{{ snow_obsdataout_prefix }}{{ observation_from_jcb }}{{ snow_obsdataout_suffix }}" + output ascii file: "{{ snow_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 2.0 + use negative longitudes: false + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "West_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [235,260] + - domain: + name: "East_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [260,294] + - domain: + name: "Alaska" + first mask variable: latitude + first mask range: [52,72] + second mask variable: longitude + second mask range: [190,230] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [38,349] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [52,343] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] + - domain: + name: "High_Mount_Asia" + first mask variable: latitude + first mask range: [20,46] + second mask variable: longitude + second mask range: [60, 111] + diff --git a/parm/jcb-gdas/observation_statistics/snow/madis_snow.yaml.j2 b/parm/jcb-gdas/observation_statistics/snow/madis_snow.yaml.j2 new file mode 100644 index 000000000..63fd6678b --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/snow/madis_snow.yaml.j2 @@ -0,0 +1,69 @@ +- obs space: + name: madis_snow + obsdatain: + engine: + type: H5File + obsfile: "{{ snow_obsdatain_path }}/{{ snow_obsdatain_prefix }}{{ observation_from_jcb }}{{ snow_obsdatain_suffix }}" + simulated variables: ['totalSnowDepth'] + observed variables: ['totalSnowDepth'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: [totalSnowDepth] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ snow_obsdataout_path }}/{{ snow_obsdataout_prefix }}{{ observation_from_jcb }}{{ snow_obsdataout_suffix }}" + output ascii file: "{{ snow_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 1.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "West_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-100] + - domain: + name: "East_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-100,-66] + - domain: + name: "Alaska" + first mask variable: latitude + first mask range: [52,72] + second mask variable: longitude + second mask range: [-170,-130] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] + - domain: + name: "High_Mount_Asia" + first mask variable: latitude + first mask range: [20,46] + second mask variable: longitude + second mask range: [60, 111] + diff --git a/parm/jcb-gdas/observation_statistics/snow/sfcsno.yaml.j2 b/parm/jcb-gdas/observation_statistics/snow/sfcsno.yaml.j2 new file mode 100644 index 000000000..818a23065 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/snow/sfcsno.yaml.j2 @@ -0,0 +1,69 @@ +- obs space: + name: sfcsno + obsdatain: + engine: + type: H5File + obsfile: "{{ snow_obsdatain_path }}/{{ snow_obsdatain_prefix }}{{ observation_from_jcb }}{{ snow_obsdatain_suffix }}" + simulated variables: ['totalSnowDepth'] + observed variables: ['totalSnowDepth'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: [totalSnowDepth] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ snow_obsdataout_path }}/{{ snow_obsdataout_prefix }}{{ observation_from_jcb }}{{ snow_obsdataout_suffix }}" + output ascii file: "{{ snow_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 1.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "West_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-100] + - domain: + name: "East_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-100,-66] + - domain: + name: "Alaska" + first mask variable: latitude + first mask range: [52,72] + second mask variable: longitude + second mask range: [-170,-130] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] + - domain: + name: "High_Mount_Asia" + first mask variable: latitude + first mask range: [20,46] + second mask variable: longitude + second mask range: [60, 111] + diff --git a/parm/jcb-gdas/observation_statistics/snow/snocvr.yaml.j2 b/parm/jcb-gdas/observation_statistics/snow/snocvr.yaml.j2 new file mode 100644 index 000000000..d90590f82 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/snow/snocvr.yaml.j2 @@ -0,0 +1,69 @@ +- obs space: + name: snocvr + obsdatain: + engine: + type: H5File + obsfile: "{{ snow_obsdatain_path }}/{{ snow_obsdatain_prefix }}{{ observation_from_jcb }}{{ snow_obsdatain_suffix }}" + simulated variables: ['totalSnowDepth'] + observed variables: ['totalSnowDepth'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: [totalSnowDepth] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ snow_obsdataout_path }}/{{ snow_obsdataout_prefix }}{{ observation_from_jcb }}{{ snow_obsdataout_suffix }}" + output ascii file: "{{ snow_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 1.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "West_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-100] + - domain: + name: "East_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-100,-66] + - domain: + name: "Alaska" + first mask variable: latitude + first mask range: [52,72] + second mask variable: longitude + second mask range: [-170,-130] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] + - domain: + name: "High_Mount_Asia" + first mask variable: latitude + first mask range: [20,46] + second mask variable: longitude + second mask range: [60, 111] + diff --git a/parm/jcb-gdas/observation_statistics/snow/snocvr_snomad.yaml.j2 b/parm/jcb-gdas/observation_statistics/snow/snocvr_snomad.yaml.j2 new file mode 100644 index 000000000..f175d6e21 --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/snow/snocvr_snomad.yaml.j2 @@ -0,0 +1,69 @@ +- obs space: + name: snocvr_snomad + obsdatain: + engine: + type: H5File + obsfile: "{{ snow_obsdatain_path }}/{{ snow_obsdatain_prefix }}{{ observation_from_jcb }}{{ snow_obsdatain_suffix }}" + simulated variables: ['totalSnowDepth'] + observed variables: ['totalSnowDepth'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: [totalSnowDepth] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ snow_obsdataout_path }}/{{ snow_obsdataout_prefix }}{{ observation_from_jcb }}{{ snow_obsdataout_suffix }}" + output ascii file: "{{ snow_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 1.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "West_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-100] + - domain: + name: "East_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-100,-66] + - domain: + name: "Alaska" + first mask variable: latitude + first mask range: [52,72] + second mask variable: longitude + second mask range: [-170,-130] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] + - domain: + name: "High_Mount_Asia" + first mask variable: latitude + first mask range: [20,46] + second mask variable: longitude + second mask range: [60, 111] + diff --git a/parm/jcb-gdas/observation_statistics/snow/snomad.yaml.j2 b/parm/jcb-gdas/observation_statistics/snow/snomad.yaml.j2 new file mode 100644 index 000000000..1bdde113d --- /dev/null +++ b/parm/jcb-gdas/observation_statistics/snow/snomad.yaml.j2 @@ -0,0 +1,69 @@ +- obs space: + name: snomad + obsdatain: + engine: + type: H5File + obsfile: "{{ snow_obsdatain_path }}/{{ snow_obsdatain_prefix }}{{ observation_from_jcb }}{{ snow_obsdatain_suffix }}" + simulated variables: ['totalSnowDepth'] + observed variables: ['totalSnowDepth'] + statistics to compute: ['mean', 'count', 'RMS'] + variables: [totalSnowDepth] + groups to process: ['ombg', 'oman'] + qc groups: ['EffectiveQC0', 'EffectiveQC1'] + output file: "{{ snow_obsdataout_path }}/{{ snow_obsdataout_prefix }}{{ observation_from_jcb }}{{ snow_obsdataout_suffix }}" + output ascii file: "{{ snow_obsdataout_path }}/{{ observation_from_jcb }}_ioda_stats.txt" + regular grid binning: + bin size in degrees: 1.0 + use negative longitudes: true + domains to process: + - domain: + name: "SH" + first mask variable: latitude + first mask range: [-90,0] + - domain: + name: "NH" + first mask variable: latitude + first mask range: [0,90] + - domain: + name: "West_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-125,-100] + - domain: + name: "East_CONUS" + first mask variable: latitude + first mask range: [25,49] + second mask variable: longitude + second mask range: [-100,-66] + - domain: + name: "Alaska" + first mask variable: latitude + first mask range: [52,72] + second mask variable: longitude + second mask range: [-170,-130] + - domain: + name: "Europe" + first mask variable: latitude + first mask range: [35,70] + second mask variable: longitude + second mask range: [-11,38] + - domain: + name: "Africa" + first mask variable: latitude + first mask range: [-35,37] + second mask variable: longitude + second mask range: [-17,52] + - domain: + name: "Asia" + first mask variable: latitude + first mask range: [0,70] + second mask variable: longitude + second mask range: [38, 180] + - domain: + name: "High_Mount_Asia" + first mask variable: latitude + first mask range: [20,46] + second mask variable: longitude + second mask range: [60, 111] + diff --git a/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_n20.yaml.j2 b/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_n20.yaml.j2 new file mode 100644 index 000000000..378358946 --- /dev/null +++ b/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_n20.yaml.j2 @@ -0,0 +1,64 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{aero_obsdatain_path}}/{{aero_obsdatain_prefix}}{{observation_from_jcb}}{{aero_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{aero_obsdataout_path}}/{{aero_obsdataout_prefix}}{{observation_from_jcb}}{{aero_obsdataout_suffix}}" + io pool: + max pool size: 2 + simulated variables: [aerosolOpticalDepth] + channels: 4 + + # Observation Operator + # -------------------- + get values: + interpolation method: barycentric + time interpolation: linear + obs operator: + name: AodCRTM + Absorbers: [H2O,O3] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id v.viirs-m_j1 + EndianType: little_endian + AerosolOption: aerosols_gocart_default + CoefficientPath: "{{crtm_coefficient_path}}" + obs error: + covariance model: diagonal + + # Observation Bias Correction (VarBC) + # ----------------------------------- + + # Observation Filters (QC) + # ------------------------ + obs filters: + - filter: PreQC + maxvalue: 1 + - filter: Domain Check + where: + - variable: + name: latitude@MetaData + minvalue: -60 + maxvalue: 60 + - filter: Bounds Check + filter variables: + - name: aerosolOpticalDepth + channels: 4 + minvalue: 0 + maxvalue: 4.9 + action: + name: reject + - filter: Background Check + channels: 4 + threshold: 3.0 + action: + name: inflate error + inflation factor: 3.0 diff --git a/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_n21.yaml.j2 b/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_n21.yaml.j2 new file mode 100644 index 000000000..efa9cdd5c --- /dev/null +++ b/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_n21.yaml.j2 @@ -0,0 +1,64 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{aero_obsdatain_path}}/{{aero_obsdatain_prefix}}{{observation_from_jcb}}{{aero_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{aero_obsdataout_path}}/{{aero_obsdataout_prefix}}{{observation_from_jcb}}{{aero_obsdataout_suffix}}" + io pool: + max pool size: 2 + simulated variables: [aerosolOpticalDepth] + channels: 4 + + # Observation Operator + # -------------------- + get values: + interpolation method: barycentric + time interpolation: linear + obs operator: + name: AodCRTM + Absorbers: [H2O,O3] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id v.viirs-m_j2 + EndianType: little_endian + AerosolOption: aerosols_gocart_default + CoefficientPath: "{{crtm_coefficient_path}}" + obs error: + covariance model: diagonal + + # Observation Bias Correction (VarBC) + # ----------------------------------- + + # Observation Filters (QC) + # ------------------------ + obs filters: + - filter: PreQC + maxvalue: 1 + - filter: Domain Check + where: + - variable: + name: latitude@MetaData + minvalue: -60 + maxvalue: 60 + - filter: Bounds Check + filter variables: + - name: aerosolOpticalDepth + channels: 4 + minvalue: 0 + maxvalue: 4.9 + action: + name: reject + - filter: Background Check + channels: 4 + threshold: 3.0 + action: + name: inflate error + inflation factor: 3.0 diff --git a/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_npp.yaml.j2 b/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_npp.yaml.j2 new file mode 100644 index 000000000..119aaf18d --- /dev/null +++ b/parm/jcb-gdas/observations/aero/retrieval_aod_viirs_npp.yaml.j2 @@ -0,0 +1,64 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{aero_obsdatain_path}}/{{aero_obsdatain_prefix}}{{observation_from_jcb}}{{aero_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{aero_obsdataout_path}}/{{aero_obsdataout_prefix}}{{observation_from_jcb}}{{aero_obsdataout_suffix}}" + missing file action: warn + io pool: + max pool size: 2 + simulated variables: [aerosolOpticalDepth] + channels: 4 + + # Observation Operator + # -------------------- + get values: + interpolation method: barycentric + time interpolation: linear + obs operator: + name: AodCRTM + Absorbers: [H2O,O3] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id v.viirs-m_npp + EndianType: little_endian + AerosolOption: aerosols_gocart_default + CoefficientPath: "{{crtm_coefficient_path}}" + obs error: + covariance model: diagonal + + # Observation Bias Correction (VarBC) + # ----------------------------------- + + # Observation Filters (QC) + # ------------------------ + obs filters: + - filter: PreQC + maxvalue: 1 + - filter: Domain Check + where: + - variable: + name: latitude@MetaData + minvalue: -60 + maxvalue: 60 + - filter: Bounds Check + filter variables: + - name: aerosolOpticalDepth + channels: 4 + minvalue: 0 + maxvalue: 4.9 + action: + name: reject + - filter: Background Check + channels: 4 + threshold: 3.0 + action: + name: inflate error + inflation factor: 3.0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/aircraft.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/aircraft.yaml.j2 new file mode 100644 index 000000000..2690123e3 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/aircraft.yaml.j2 @@ -0,0 +1,365 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsgrouping: + group variables: ["stationIdentification"] + sort variable: "pressure" + sort order: "descending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward, airTemperature, specificHumidity] + # + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + # + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Observation Range Sanity Check + - filter: Bounds Check + filter variables: + - name: airTemperature + minvalue: 195 + maxvalue: 327 + action: + name: reject + # + - filter: Bounds Check + filter variables: + - name: specificHumidity + minvalue: 1.0E-7 + maxvalue: 0.034999999 + action: + name: reject + # + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130 + maxvalue: 130 + action: + name: reject + # + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130.0 + action: + name: reject + # Reject when pressure is less than 126 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/pressure + minvalue: 12600 + action: + name: reject + # + # Reject all obs with PreQC mark already set above 3 + # - filter: PreQC + # maxvalue: 3 + # action: + # name: reject + # + #-------------------------------------------------------------------------------------------------------------------- + # Wind + #-------------------------------------------------------------------------------------------------------------------- + # + # Begin by assigning all ObsError to a constant value. These will get overwritten (as needed) for specific types. + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 2.0 # 2.0 m/s + # Assign intial ObsError specific to AIREP/ACARS + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 3.6 # 3.6 m/s + where: + - variable: + name: ObsType/windEastward + is_in: 230 + # Assign intial ObsError specific to AMDAR + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 3.0 # 3.0 m/s + where: + - variable: + name: ObsType/windEastward + is_in: 231 + # Assign intial ObsError specific to MDCRS + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 2.5 # 2.5 m/s + where: + - variable: + name: ObsType/windEastward + is_in: 233 + # + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 80000, 65000, 60000, 55000, 50000, 45000, 40000, + 35000, 30000, 25000, 20000, 15000, 10000] #Pressure (Pa) + errors: [1.4, 1.5, 1.6, 1.8, 1.9, 2.0, 2.1, 2.3, 2.6, 2.8, 3.0, 3.2, 2.7, + 2.4, 2.1] + # Assign the initial ObsError, based on height/pressure for RECON aircraft + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [70000, 65000, 60000, 55000, 50000, 45000, 40000, 35000, 30000, 25000, + 20000, 15000, 10000, 7500, 5000] + errors: [2.4, 2.5, 2.6, 2.7, 2.8, 2.95, 3.1, 3.25, 3.4, 3.175, 2.95, 2.725, + 2.5, 2.6, 2.7] + where: + - variable: + name: ObsType/windEastward + is_in: 232 + # Reject when difference of wind direction is more than 50 degrees. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/WindDirAngleDiff + options: + minimum_uv: 3.5 + maxvalue: 50.0 + action: + name: reject + defer to post: true + # When multiple obs exist within a single vertical model level, inflate ObsError + # - filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsFunction/ObsErrorFactorConventional + # options: + # test QCflag: PreQC + # inflate variables: [windEastward] + # defer to post: true + # + # - filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsFunction/ObsErrorFactorConventional + # options: + # test QCflag: PreQC + # inflate variables: [windNorthward] + # defer to post: true + # + # Gross error check with (O - B) / ObsError greater than threshold. + - filter: Background Check + filter variables: + - name: windEastward + - name: windNorthward + threshold: 6.0 + absolute threshold: 19.0 + action: + name: reject + # + #-------------------------------------------------------------------------------------------------------------------- + # Temperature + #-------------------------------------------------------------------------------------------------------------------- + # + # Begin by assigning all ObsError to a constant value. These will get overwritten for specific types. + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error parameter: 2.0 # 2.0 K + # Assign the initial observation error, based on pressure (for AIREP/ACARS; itype=130) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 80000] + errors: [2.5, 2.3, 2.1, 1.9, 1.7] + where: + - variable: + name: ObsType/airTemperature + is_in: 130 + # Assign the initial observation error, based on pressure (for AMDAR and MDCRS; itype=131,133) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 80000] + errors: [1.4706, 1.3529, 1.2353, 1.1176, 1.0] + where: + - variable: + name: ObsType/airTemperature + is_in: 131,133 + # Assign the initial observation error, based on pressure (for RECON aircraft; itype=132) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 35000, 30000, 25000, 20000, 15000, + 10000, 7500, 5000, 4000, 3200, 2000, 1000] + errors: [1.2, 1.1, 0.9, 0.8, 0.8, 0.9, 1.2, 1.2, 1.0, 0.8, 0.8, 0.9, 0.95, + 1.0, 1.25, 1.5] + where: + - variable: + name: ObsType/airTemperature + is_in: 132 + # When multiple obs exist within a single vertical model level, inflate ObsError + # - filter: Perform Action + # filter variables: + # - name: airTemperature + # action: + # name: inflate error + # inflation variable: + # name: ObsFunction/ObsErrorFactorConventional + # options: + # test QCflag: PreQC + # inflate variables: [airTemperature] + # defer to post: true + # Gross error check with (O - B) / ObsError greater than threshold. + - filter: Background Check + filter variables: + - name: airTemperature + threshold: 7.0 + absolute threshold: 8.0 + action: + name: reject + # + #-------------------------------------------------------------------------------------------------------------------- + # Moisture + #-------------------------------------------------------------------------------------------------------------------- + # + # Assign the initial observation error, based on height/pressure ONLY MDCRS + - filter: Perform Action + filter variables: + - name: specificHumidity + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000, 105000, 100000, 95000, 90000, 85000, 80000, 75000, 70000, + 65000, 60000, 55000, 50000, 45000, 40000, 35000, 30000, 25000, 20000, + 15000, 10000, 7500, 5000, 4000, 3000] + errors: [.19455, .19062, .18488, .17877, .17342, .16976, .16777, .16696, + .16605, .16522, .16637, .17086, .17791, .18492, .18996, .19294, .19447, + .19597, .19748, .19866, .19941, .19979, .19994, .19999, .2] + scale_factor_var: ObsValue/specificHumidity + where: + - variable: + name: ObsType/specificHumidity + is_in: 133 + # When multiple obs exist within a single vertical model level, inflate ObsError + # - filter: Perform Action + # filter variables: + # - name: specificHumidity + # action: + # name: inflate error + # inflation variable: + # name: ObsFunction/ObsErrorFactorConventional + # options: + # test QCflag: PreQC + # inflate variables: [specificHumidity] + # defer to post: true + # Gross error check with (O - B) / ObsError greater than threshold. + - filter: Background Check + filter variables: + - name: specificHumidity + threshold: 8.0 + action: + name: reject + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/conventional_ps.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/conventional_ps.yaml.j2 new file mode 100644 index 000000000..a9be15805 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/conventional_ps.yaml.j2 @@ -0,0 +1,373 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure] + + # Observation Operator + # -------------------- + obs operator: + name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + station_altitude: height + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + variables: + - name: stationPressure + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Initial Error Assignments for SFC Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [181] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [187] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [85000, 80000, 75000, 70000, 65000, 60000, 55000] + errors: [120, 140, 140, 140, 140, 140, 1.0e+11] + # Initial Error Assignments for SFCSHIP Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [180] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [60000, 55000] + errors: [130, 1.0e+11] + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [183] + action: + name: assign error + error parameter: 1.0e+11 + + # Initial Error Assignments for Radiosonde + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [120] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: InputObsError/stationPressure + type: float + source variable: ObsErrorData/stationPressure + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/stationPressure + type: int + source variable: QualityMarker/stationPressure + + # Create PreUseFlag group variable (usage in GSI read_prepbufr) + # Initialize + - filter: Variable Assignment + assignments: + - name: PreUseFlag/stationPressure + type: int + source variable: PreQC/stationPressure + + - filter: Variable Assignment + where: + - variable: + name: PreUseFlag/stationPressure + is_in: 1-15 + assignments: + - name: PreUseFlag/stationPressure + value: 0 + # Re-assignment + - filter: Variable Assignment + where: + - variable: + name: ObsType/stationPressure + is_in: 183 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: ObsValue/stationPressure + is_defined: + - variable: + name: ObsValue/stationPressure + maxvalue: 50000.00 + where operator: and + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 9, 12, 15 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 4-15 + assignments: + - name: PreUseFlag/stationPressure + value: 101 + + ## Observation range sanity check + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 37499.0 + # maxvalue: 106999.0 + # action: + # name: reject + ## Reject all ObsType 183 + #- filter: RejectList + # where: + # - variable: + # name: ObsType/stationPressure + # is_in: 183 + ## Reject surface pressure below 500 hPa + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 50000.00 + # action: + # name: reject + #- filter: RejectList + # where: + # - variable: + # name: PreQC/stationPressure + # is_in: 4-15 + # Inflate obs error based on obs type + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3, 7 + action: + name: inflate error + inflation factor: 1.2 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Calculate obs error inflation factors for duplicated observations at the same location + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorDuplicateCheck/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorDuplicateCheck + options: + use_air_pressure: false + variable: stationPressure + + # Reduce effective observation error based on obs type and subtype + # In this case: reduce effective obs error for buoy + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: + name: ObsType/stationPressure + is_in: 180 + - variable: + name: ObsSubType/stationPressure + is_in: 0 + action: + name: inflate error + inflation factor: 0.7 + + # Calculate obs error inflation factors for large discrepancies between model and observations + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSfcPressure/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorSfcPressure + options: + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + station_altitude: height + + # Inflate surface pressure observation based on discrepancies between + # model and observations due to terrian + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSfcPressure/stationPressure + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/Innovation + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/stationPressure + - name: HofX/stationPressure + coefs: [1, -1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 5.0 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_not_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + action: + name: reject + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 3.5 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + action: + name: reject + + # Inflate obs error based on duplicate check + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorDuplicateCheck/stationPressure + + # Reject data based on PreUseFlag (usage in GSI) + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreUseFlag/stationPressure + is_not_in: 0, 1 + action: + name: reject + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/gnssro.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/gnssro.yaml.j2 new file mode 100644 index 000000000..df980564e --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/gnssro.yaml.j2 @@ -0,0 +1,167 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + # obsgrouping: + # group variables: [ "sequenceNumber" ] + # sort variable: "impactHeightRO" + # sort order: "ascending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Diagnostic flag for qfro + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: qfroCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + # Step 0-B: qfro Check - good: 0, reject: 1 + - filter: Bounds Check + - filter: RejectList + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 3-5,421,440,821 + test variables: + - name: MetaData/qualityFlags + minvalue: -0.1 + maxvalue: 0.1 + actions: + - name: set + flag: qfroCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #2. commgpstop + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265,266,267,268,269 + test variables: + - name: MetaData/impactHeightRO + maxvalue: 45000.1 + action: + name: reject + #3. metop below 8 km + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 3-5 + test variables: + - name: MetaData/impactHeightRO + minvalue: 8000.1 + action: + name: reject + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + #5. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + #6. Obs error inflate + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + #7. Background check + #- filter: Background Check + # filter variables: + # - name: bendingAngle + # threshold: 10 + # action: + # name: reject + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/gnssro_cosmic2.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/gnssro_cosmic2.yaml.j2 new file mode 100644 index 000000000..8651b324e --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/gnssro_cosmic2.yaml.j2 @@ -0,0 +1,104 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max obs: 10000 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_amsua_n19.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_amsua_n19.yaml.j2 new file mode 100644 index 000000000..de4116299 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_amsua_n19.yaml.j2 @@ -0,0 +1,108 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels 4-6,9-14 + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id amsua_n19 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + + # Observation Error + # ----------------- + obs error: + covariance model: diagonal + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs filters: + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 100.0 + maxvalue: 500.0 + action: + name: reject + # Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + threshold: 3.0 + action: + name: reject + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_atms_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_atms_n20.yaml.j2 new file mode 100644 index 000000000..a2c0b5f4e --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_atms_n20.yaml.j2 @@ -0,0 +1,546 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id atms_n20 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 0-A: Create Diagnostic Flags + - filter: Create Diagnostic Flags + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + flags: + - name: ScanEdgeRemoval + initial value: false + force reinitialization: false + - name: Thinning + initial value: false + force reinitialization: false + - name: CLWRetrievalCheck + initial value: false + force reinitialization: false + - name: WindowChannelExtremeResidual + initial value: false + force reinitialization: false + - name: HydrometeorCheck + initial value: false + force reinitialization: false + - name: GrossCheck + initial value: false + force reinitialization: false + - name: InterChannelConsistency + initial value: false + force reinitialization: false + - name: UseflagCheck + initial value: false + force reinitialization: false + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 0-B: Calculate derived variables + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromObs@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromBkg@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + # Calculate symmetric retrieved CLW + - filter: Variable Assignment + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + value: 1000.0 + + - filter: Variable Assignment + where: + - variable: + name: CLWRetFromObs@DerivedMetaData + minvalue: 0. + maxvalue: 999. + - variable: + name: CLWRetFromBkg@DerivedMetaData + minvalue: 0. + maxvalue: 999. + where operator: and + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + function: + name: Arithmetic@ObsFunction + options: + variables: + - name: CLWRetFromObs@DerivedMetaData + - name: CLWRetFromBkg@DerivedMetaData + total coefficient: 0.5 + + # Calculate scattering index from observation + - filter: Variable Assignment + assignments: + - name: SIRetFromObs@DerivedMetaData + type: float + function: + name: SCATRetMW@ObsFunction + options: + scatret_ch238: 1 + scatret_ch314: 2 + scatret_ch890: 16 + scatret_types: [ObsValue] + # Calculate CLW obs/bkg match index + - filter: Variable Assignment + assignments: + - name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: CLWMatchIndexMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwret_clearsky: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, + 0.030, 0.030, 0.050, 0.100] + # Calculate symmetric observation error + - filter: Variable Assignment + assignments: + - name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorModelRamp@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: CLWRetSymmetric@DerivedMetaData + x0: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, 0.030, 0.030, + 0.050, 0.100] + x1: [0.350, 0.380, 0.400, 0.450, 0.500, 1.000, 1.000, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.350, 0.500, 0.500, 0.500, 0.500, + 0.500, 0.500] + err0: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, 0.400, 0.400, + 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, 3.000, 3.000, + 3.000, 3.000] + err1: [20.000, 25.000, 12.000, 7.000, 3.500, 3.000, 0.800, 0.400, 0.400, + 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 19.000, 30.000, 25.000, 16.500, + 12.000, 9.000, 6.500] + # Calculate Innovation@DerivedMetaData + - filter: Variable Assignment + assignments: + - name: Innovation@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/Arithmetic + channels: *{{observation_from_jcb}}_simulated_channels + options: + variables: + - name: brightnessTemperature@ObsValue + channels: *{{observation_from_jcb}}_simulated_channels + - name: brightnessTemperature@HofX + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [1, -1] + # Step 0-C: Assign Initial All-Sky Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + # Step 1: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 1-22 + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 7-90 + actions: + - name: set + flag: ScanEdgeRemoval + - name: reject + + # Step 2: Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + actions: + - name: set + flag: Thinning + - name: reject + + # Step 3A: CLW Retrieval Check (observation_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromObs@DerivedMetaData + maxvalue: 999.0 + actions: + - name: set + flag: CLWRetrievalCheck + - name: reject + + # Step 3B: CLW Retrieval Check (background_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromBkg@DerivedMetaData + maxvalue: 999.0 + actions: + - name: set + flag: CLWRetrievalCheck + - name: reject + + # Step 4: Window Channel Sanity Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16, 17-22 + test variables: + - name: Innovation@DerivedMetaData + channels: 1, 2, 5-7, 16 + maxvalue: 200.0 + minvalue: -200.0 + flag all filter variables if any test variable is out of bounds: true + actions: + - name: set + flag: WindowChannelExtremeResidual + - name: reject + + # Step 5: Hydrometeor Check (cloud/precipitation affected chanels) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: HydrometeorCheckATMS@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + clwret_function: + name: CLWRetFromObs@DerivedMetaData + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.0 + actions: + - name: set + flag: HydrometeorCheck + ignore: rejected observations + - name: reject + + # Step 6: Observation Error Inflation based on Topography Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTopoRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + # Step 7: Obs Error Inflation based on TOA Transmittancec Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTransmitTopRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + # Step 8: Observation Error Inflation based on Surface Jacobian Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSurfJacobianRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.020, 0.015, 0.020, 0.200] + obserr_dtempf: [0.500, 2.000, 1.000, 2.000, 4.500] + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + # Step 9: Situation Dependent Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSituDependMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + scatobs_function: + name: SIRetFromObs@DerivedMetaData + clwmatchidx_function: + name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + # Step 10: Gross check + # Remove data if abs(Obs-HofX) > absolute threhold + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorLat@DerivedMetaData + type: float + function: + name: ObsErrorFactorLatRad@ObsFunction + options: + latitude_parameters: [25.0, 0.25, 0.04, 3.0] + - filter: Variable Assignment + assignments: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorBoundMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsErrorFactorLat@DerivedMetaData + obserr_bound_transmittop: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_topo: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + threhold: 3 + obserr_bound_max: [4.5, 4.5, 3.0, 3.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, + 1.0, 1.0, 2.0, 4.5, 4.5, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0] + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + actions: + - name: set + flag: GrossCheck + ignore: rejected observations + - name: reject + + # Step 11: Inter-Channel Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: InterChannelConsistencyCheck@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use passive_bc: true + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + maxvalue: 1.0e-12 + actions: + - name: set + flag: InterChannelConsistency + ignore: rejected observations + - name: reject + + # Step 12: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + minvalue: 1.0e-12 + actions: + - name: set + flag: UseflagCheck + ignore: rejected observations + - name: reject + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_atms_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_atms_npp.yaml.j2 new file mode 100644 index 000000000..2842cae62 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_atms_npp.yaml.j2 @@ -0,0 +1,564 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id atms_npp + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 0-A: Create Diagnostic Flags + - filter: Create Diagnostic Flags + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + flags: + - name: ScanEdgeRemoval + initial value: false + force reinitialization: false + - name: Thinning + initial value: false + force reinitialization: false + - name: CLWRetrievalCheck + initial value: false + force reinitialization: false + - name: WindowChannelExtremeResidual + initial value: false + force reinitialization: false + - name: HydrometeorCheck + initial value: false + force reinitialization: false + - name: GrossCheck + initial value: false + force reinitialization: false + - name: InterChannelConsistency + initial value: false + force reinitialization: false + - name: UseflagCheck + initial value: false + force reinitialization: false + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 0-B: Calculate derived variables + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromObs@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromBkg@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + + # Calculate symmetric retrieved CLW + - filter: Variable Assignment + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + value: 1000.0 + + - filter: Variable Assignment + where: + - variable: + name: CLWRetFromObs@DerivedMetaData + minvalue: 0. + maxvalue: 999. + - variable: + name: CLWRetFromBkg@DerivedMetaData + minvalue: 0. + maxvalue: 999. + where operator: and + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + function: + name: Arithmetic@ObsFunction + options: + variables: + - name: CLWRetFromObs@DerivedMetaData + - name: CLWRetFromBkg@DerivedMetaData + total coefficient: 0.5 + + # Calculate scattering index from observation + - filter: Variable Assignment + assignments: + - name: SIRetFromObs@DerivedMetaData + type: float + function: + name: SCATRetMW@ObsFunction + options: + scatret_ch238: 1 + scatret_ch314: 2 + scatret_ch890: 16 + scatret_types: [ObsValue] + + # Calculate CLW obs/bkg match index + - filter: Variable Assignment + assignments: + - name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: CLWMatchIndexMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwret_clearsky: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, + 0.030, 0.030, 0.050, 0.100] + + # Calculate symmetric observation error + - filter: Variable Assignment + assignments: + - name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorModelRamp@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: CLWRetSymmetric@DerivedMetaData + x0: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, 0.030, 0.030, + 0.050, 0.100] + x1: [0.350, 0.380, 0.400, 0.450, 0.500, 1.000, 1.000, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.350, 0.500, 0.500, 0.500, 0.500, + 0.500, 0.500] + err0: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, 0.400, 0.400, + 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, 3.000, 3.000, + 3.000, 3.000] + err1: [20.000, 25.000, 12.000, 7.000, 3.500, 3.000, 0.800, 0.400, 0.400, + 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 19.000, 30.000, 25.000, 16.500, + 12.000, 9.000, 6.500] + + # Calculate Innovation@DerivedMetaData + - filter: Variable Assignment + assignments: + - name: Innovation@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/Arithmetic + channels: *{{observation_from_jcb}}_simulated_channels + options: + variables: + - name: brightnessTemperature@ObsValue + channels: *{{observation_from_jcb}}_simulated_channels + - name: brightnessTemperature@HofX + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [1, -1] + + # Step 0-C: Assign Initial All-Sky Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 1: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 1-22 + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 7-90 + actions: + - name: set + flag: ScanEdgeRemoval + - name: reject + + # Step 2: Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + actions: + - name: set + flag: Thinning + - name: reject + + # Step 3A: CLW Retrieval Check (observation_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromObs@DerivedMetaData + maxvalue: 999.0 + actions: + - name: set + flag: CLWRetrievalCheck + - name: reject + + # Step 3B: CLW Retrieval Check (background_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromBkg@DerivedMetaData + maxvalue: 999.0 + actions: + - name: set + flag: CLWRetrievalCheck + - name: reject + + # Step 4: Window Channel Sanity Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16, 17-22 + test variables: + - name: Innovation@DerivedMetaData + channels: 1, 2, 5-7, 16 + maxvalue: 200.0 + minvalue: -200.0 + flag all filter variables if any test variable is out of bounds: true + actions: + - name: set + flag: WindowChannelExtremeResidual + - name: reject + + # Step 5: Hydrometeor Check (cloud/precipitation affected chanels) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: HydrometeorCheckATMS@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + clwret_function: + name: CLWRetFromObs@DerivedMetaData + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.0 + actions: + - name: set + flag: HydrometeorCheck + ignore: rejected observations + - name: reject + + # Step 6: Observation Error Inflation based on Topography Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTopoRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 7: Obs Error Inflation based on TOA Transmittancec Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTransmitTopRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Observation Error Inflation based on Surface Jacobian Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSurfJacobianRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.020, 0.015, 0.020, 0.200] + obserr_dtempf: [0.500, 2.000, 1.000, 2.000, 4.500] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 9: Situation Dependent Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSituDependMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + scatobs_function: + name: SIRetFromObs@DerivedMetaData + clwmatchidx_function: + name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 10: Gross check + # Remove data if abs(Obs-HofX) > absolute threhold + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorLat@DerivedMetaData + type: float + function: + name: ObsErrorFactorLatRad@ObsFunction + options: + latitude_parameters: [25.0, 0.25, 0.04, 3.0] + + - filter: Variable Assignment + assignments: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorBoundMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsErrorFactorLat@DerivedMetaData + obserr_bound_transmittop: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_topo: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + threhold: 3 + obserr_bound_max: [4.5, 4.5, 3.0, 3.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, + 1.0, 1.0, 2.0, 4.5, 4.5, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0] + + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + actions: + - name: set + flag: GrossCheck + ignore: rejected observations + - name: reject + + # Step 11: Inter-Channel Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: InterChannelConsistencyCheck@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use passive_bc: true + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + maxvalue: 1.0e-12 + actions: + - name: set + flag: InterChannelConsistency + ignore: rejected observations + - name: reject + + # Step 12: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + minvalue: 1.0e-12 + actions: + - name: set + flag: UseflagCheck + ignore: rejected observations + - name: reject + +# Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_iasi_metop-a.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_iasi_metop-a.yaml.j2 new file mode 100644 index 000000000..e82979e41 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_iasi_metop-a.yaml.j2 @@ -0,0 +1,530 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + observed variables: [radiance] + simulated variables: [brightnessTemperature] + derived variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id iasi_metop-a + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: *{{observation_from_jcb}}_simulated_channels + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/radiance + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [25.0] + intercept: 64475.0 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/radiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [1.38, 0.81, 0.75, 0.79, 0.72, 0.74, + 0.68, 0.72, 0.65, 0.65, 0.65, 0.69, 0.64, 0.64, 0.65, 0.67, 0.62, 0.61, 0.62, + 0.64, 0.59, 0.76, 1.22, 0.78, 0.64, 0.62, 0.61, 0.69, 0.65, 0.59, 0.61, 0.59, + 0.68, 0.62, 0.68, 4.38, 3.05, 2.31, 1.56, 1.33, 1.58, 0.93, 1.67, 0.72, 0.57, + 0.58, 0.55, 0.68, 0.59, 0.68, 0.59, 0.65, 0.58, 0.62, 0.64, 0.58, 0.64, 0.55, + 0.64, 0.5, 0.82, 0.59, 0.62, 0.51, 0.64, 0.52, 0.51, 0.51, 0.76, 0.52, 0.57, + 0.55, 0.69, 0.58, 0.65, 0.61, 0.59, 0.64, 0.76, 0.72, 1.05, 0.75, 0.51, 0.65, + 1.3, 0.69, 0.93, 1.49, 1.12, 0.68, 0.66, 0.67, 0.59, 0.59, 0.69, 0.67, 0.64, + 0.62, 0.72, 0.69, 0.66, 0.79, 0.78, 0.74, 0.88, 0.77, 0.88, 0.86, 1, 0.87, + 0.85, 0.88, 0.84, 0.84, 0.84, 0.8, 0.8, 0.87, 0.98, 0.52, 0.65, 0.69, 0.61, + 0.6, 0.67, 0.79, 0.62, 0.66, 0.7, 0.65, 0.62, 0.61, 0.62, 0.53, 0.6, 0.68, + 0.95, 0.63, 0.97, 0.65, 0.98, 0.58, 0.73, 0.65, 0.85, 0.99, 0.76, 0.85, 0.97, + 0.77, 0.62, 0.63, 1.21, 1.41, 1.55, 1.78, 1.35, 1.14, 1.69, 1.79, 1.46, 1.63, + 1.94, 2.01, 1.24, 1.76, 1.26, 1.47, 1.9, 1.66, 2.13, 1.49, 1.52, 1.55, 1.96, + 2.31, 2.33, 2.32, 2.31, 2.33, 2.23, 2.33, 1.84, 2.29, 2.28, 2.28, 2.28, 2.26, + 2.26, 2.26, 2.27, 2.24, 2.23, 2.24, 2.26, 2.28, 2.28, 2.3, 2.15, 2.31, 2.37, + 2.27, 2.29, 2.29, 2.23, 2.28, 2.32, 2.32, 2.31, 2.32, 2.32, 2.31, 2.31, 2.28, + 2.29, 2.28, 2.26, 2.29, 2.27, 2.26, 2.25, 2.27, 2.24, 2.21, 2.24, 2.17, 2.18, + 2.17, 2.21, 1.99, 2.16, 2.2, 2.13, 2.12, 2.13, 2.1, 2.12, 2.11, 2.09, 2.09, + 2.08, 2.09, 2.04, 2.04, 2.1, 2.01, 2.05, 2.03, 2.06, 1.98, 1.95, 1.94, 1.91, + 1.7, 1.76, 1.77, 1.83, 2.04, 1.91, 1.99, 1.99, 2.07, 2.02, 2.04, 2.1, 2.06, + 2.18, 2.21, 2.24, 2.23, 2.23, 1.98, 2.2, 2.18, 2.18, 2.21, 2.23, 2.24, 2.24, + 2.25, 1.8, 2.24, 1.73, 1.73, 2.27, 1.67, 2.21, 1.72, 2.23, 2.23, 2.23, 2.24, + 2.23, 2.12, 2.17, 1.74, 2.02, 1.88, 1.67, 1.73, 1.83, 1.82, 1.73, 1.83, 2.19, + 1.84, 1.89, 1.6, 1.71, 1.86, 1.85, 1.84, 1.87, 1.91, 1.52, 1.95, 1.87, 1.89, + 1.91, 1.91, 1.93, 1.9, 1.91, 1.9, 1.89, 1.89, 1.91, 1.9, 1.91, 1.91, 1.91, + 1.93, 1.94, 1.91, 1.92, 1.77, 1.91, 1.95, 1.19, 1.96, 1.98, 1.94, 1.55, 1.91, + 1.92, 1.92, 1.97, 1.93, 1.99, 1.86, 1.12, 1.93, 1.92, 1.95, 1.85, 1.84, 1.91, + 1.12, 1.82, 1.82, 1.95, 1.24, 1.94, 1.96, 1.21, 1.83, 1.96, 1.36, 1.96, 1.82, + 1.92, 1.68, 1.93, 1.23, 1.96, 1.93, 1.86, 1.41, 1.16, 1.6, 1.25, 1.2, 1.65, + 1.66, 1.87, 1.94, 1.96, 1.91, 1.25, 1.93, 1.91, 1.7, 0.99, 1.81, 1.92, 1.95, + 1.5, 1.47, 1.15, 1.58, 1.18, 1.82, 1.13, 1.83, 1.91, 1.26, 1.27, 1.91, 1.45, + 1.6, 1.29, 1.94, 1.94, 1.23, 1.95, 1.21, 1.94, 1.86, 1.9, 1.33, 1.75, 2.02, + 1.98, 2.03, 1.83, 1.5, 2.04, 2.02, 1.9, 2, 2.02, 1.95, 1.93, 1.95, 1.95, 1.99, + 2, 1.94, 1.96, 1.86, 1.92, 1.88, 1.86, 1.84, 1.87, 1.77, 1.89, 1.89, 1.88, + 1.94, 1.82, 1.79, 1.86, 2.06, 2.33, 1.88, 1.86, 1.81, 1.8, 1.8, 1.86, 1.9, + 2, 2.06, 2.1, 2.2, 2, 2.16, 1.98, 1.8, 1.8, 1.85, 1.75, 2.04, 2.19, 2.14, + 2.19, 1.86, 2.1, 2.11, 2.18, 2.03, 2.28, 2.19, 2.26, 2.26, 2.21, 2.21, 2.26, + 2.33, 2.27, 2.21, 2.12, 2.23, 2.26, 2.25, 1.88, 2.26, 2.24, 2.36, 2.29, 2.35, + 2.3, 2.27, 2.08, 2.05, 2.27, 2.28, 2.27, 2.28, 1.97, 2.25, 2.25, 2.25, 2.31, + 2.28, 2.27, 2.13, 2.24, 2.28, 2.28, 2.41, 2.34, 9.32, 2.28, 2.38, 2.27, 2.27, + 2.39, 2.11, 2.09, 2.1, 2.06, 2.12, 2.08, 2, 1.93, 2.02, 2.55, 1.54, 1.64, + 1.51, 1.55, 2.82, 2.92, 2.55, 2.37, 1.85, 1.6, 1.72, 1.74, 1.79, 1.9, 1.94, + 2, 2.04, 2.08, 2.12, 2.13, 2.16, 2.18, 2.18, 2.2, 2.2, 2.41, 2.39, 2.38, 2.4, + 2.42, 2.41, 2.43, 2.45, 2.43, 2.45, 2.43, 2.4, 2.44, 2.4, 2.42, 2.43, 2.45, + 2.45, 2.45, 2.46, 2.45, 2.45, 2.43, 2.51, 2.48, 2.48, 2.53, 2.46, 2.49, 2.5, + 2.5, 2.5, 2.52, 2.52, 2.54, 2.5, 2.48, 2.5, 2.55, 2.5, 2.48, 2.5, 2.5, 2.52, + 2.52, 2.48, 2.5, 2.5, 2.52, 2.46, 2.53, 9] + + # Step 4: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 5-56 + action: + name: reject + name: reduce obs space + + # Step 5: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: MetaData/fractionOfClearPixelsInFOV + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reject + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 6: Wavenumber Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 7024, 7027, 7029, 7032, 7038, 7043, 7046, 7049, 7069, 7072, 7076, + 7081, 7084, 7089, 7099, 7209, 7222, 7231, 7235, 7247, 7267, 7269, 7284, 7389, + 7419, 7423, 7424, 7426, 7428, 7431, 7436, 7444, 7475, 7549, 7584, 7665, 7666, + 7831, 7836, 7853, 7865, 7885, 7888, 7912, 7950, 7972, 7980, 7995, 8007, 8015, + 8055, 8078 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: water_area_fraction@GeoVaLs + minvalue: 1.0e-12 + action: + name: reject + + # Step 7: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorWavenumIR@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 9: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 10: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 11: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, + 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, -1, -1, + -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, -1, + 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, -1, -1, + 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, 1, 1, + 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, -1, -1, + 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, -1, 1, -1, + 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, 1, 1, -1, + -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, 1, + -1, 1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, -1, -1, -1, -1, -1, 1, -1, 1, -1, + 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, + -1, -1, 1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, + -1, -1, -1, -1, -1, 1, 1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, + -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1] + use_flag_clddet: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, + 1, -1, 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, -1, 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, + -1, -1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, + 1, 1, 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, + -1, -1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, + 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, + -1, 1, -1, 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, + 1, 1, -1, -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, + -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 12: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: NearSSTRetCheckIR@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, + 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, -1, -1, + -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, -1, + 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, -1, -1, + 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, 1, 1, + 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, -1, -1, + 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, -1, 1, -1, + 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, 1, 1, -1, + -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, 1, + -1, 1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, -1, -1, -1, -1, -1, 1, -1, 1, -1, + 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, + -1, -1, 1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, + -1, -1, -1, -1, -1, 1, 1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, + -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1] + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 13: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 14: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 4.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 4.0, 4.0, 3.5, + 2.5, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 3.5, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.5, 2.0, 2.5, 2.5, 3.0, 2.5, 2.5, 2.5, 2.5, 3.5, 2.5, 2.5, + 3.0, 3.5, 3.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.5, 4.5, 4.5, 4.5, 4.5, 4.0, + 4.5, 4.0, 4.0, 4.5, 2.5, 3.0, 2.5, 3.0, 2.5, 3.0, 2.0, 2.5, 2.5, 3.0, 3.0, + 2.5, 3.0, 3.0, 3.0, 2.5, 2.5, 4.0, 4.5, 4.5, 5.0, 4.0, 4.0, 5.0, 5.0, 5.0, + 5.0, 5.5, 5.5, 4.0, 5.0, 4.0, 4.5, 5.5, 5.5, 6.0, 4.5, 4.5, 4.0, 5.0, 5.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 5.5, 4.5, 6.0, 5.0, 5.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 4.0, 6.0, 6.0, 6.0, 6.0, 4.5, 6.0, 6.0, 4.5, + 6.0, 6.0, 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 5.0, 6.0, 5.0, + 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 15: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, + 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, -1, -1, + -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, -1, + 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, -1, -1, + 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, 1, 1, + 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, -1, -1, + 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, -1, 1, -1, + 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, 1, 1, -1, + -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, 1, + -1, 1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, -1, -1, -1, -1, -1, 1, -1, 1, -1, + 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, + -1, -1, 1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, + -1, -1, -1, -1, -1, 1, 1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, + -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1] + minvalue: 1.0e-12 + action: + name: reject + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_iasi_metop-b.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_iasi_metop-b.yaml.j2 new file mode 100644 index 000000000..50796f517 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/radiance_iasi_metop-b.yaml.j2 @@ -0,0 +1,530 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + observed variables: [radiance] + simulated variables: [brightnessTemperature] + derived variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id iasi_metop-b + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: *{{observation_from_jcb}}_simulated_channels + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/radiance + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [25.0] + intercept: 64475.0 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/radiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [1.38, 0.81, 0.75, 0.79, 0.72, 0.74, + 0.68, 0.72, 0.65, 0.65, 0.65, 0.69, 0.64, 0.64, 0.65, 0.67, 0.62, 0.61, 0.62, + 0.64, 0.59, 0.76, 1.22, 0.78, 0.64, 0.62, 0.61, 0.69, 0.65, 0.59, 0.61, 0.59, + 0.68, 0.62, 0.68, 4.38, 3.05, 2.31, 1.56, 1.33, 1.58, 0.93, 1.67, 0.72, 0.57, + 0.58, 0.55, 0.68, 0.59, 0.68, 0.59, 0.65, 0.58, 0.62, 0.64, 0.58, 0.64, 0.55, + 0.64, 0.5, 0.82, 0.59, 0.62, 0.51, 0.64, 0.52, 0.51, 0.51, 0.76, 0.52, 0.57, + 0.55, 0.69, 0.58, 0.65, 0.61, 0.59, 0.64, 0.76, 0.72, 1.05, 0.75, 0.51, 0.65, + 1.3, 0.69, 0.93, 1.49, 1.12, 0.68, 0.66, 0.67, 0.59, 0.59, 0.69, 0.67, 0.64, + 0.62, 0.72, 0.69, 0.66, 0.79, 0.78, 0.74, 0.88, 0.77, 0.88, 0.86, 1, 0.87, + 0.85, 0.88, 0.84, 0.84, 0.84, 0.8, 0.8, 0.87, 0.98, 0.52, 0.65, 0.69, 0.61, + 0.6, 0.67, 0.79, 0.62, 0.66, 0.7, 0.65, 0.62, 0.61, 0.62, 0.53, 0.6, 0.68, + 0.95, 0.63, 0.97, 0.65, 0.98, 0.58, 0.73, 0.65, 0.85, 0.99, 0.76, 0.85, 0.97, + 0.77, 0.62, 0.63, 1.21, 1.41, 1.55, 1.78, 1.35, 1.14, 1.69, 1.79, 1.46, 1.63, + 1.94, 2.01, 1.24, 1.76, 1.26, 1.47, 1.9, 1.66, 2.13, 1.49, 1.52, 1.55, 1.96, + 2.31, 2.33, 2.32, 2.31, 2.33, 2.23, 2.33, 1.84, 2.29, 2.28, 2.28, 2.28, 2.26, + 2.26, 2.26, 2.27, 2.24, 2.23, 2.24, 2.26, 2.28, 2.28, 2.3, 2.15, 2.31, 2.37, + 2.27, 2.29, 2.29, 2.23, 2.28, 2.32, 2.32, 2.31, 2.32, 2.32, 2.31, 2.31, 2.28, + 2.29, 2.28, 2.26, 2.29, 2.27, 2.26, 2.25, 2.27, 2.24, 2.21, 2.24, 2.17, 2.18, + 2.17, 2.21, 1.99, 2.16, 2.2, 2.13, 2.12, 2.13, 2.1, 2.12, 2.11, 2.09, 2.09, + 2.08, 2.09, 2.04, 2.04, 2.1, 2.01, 2.05, 2.03, 2.06, 1.98, 1.95, 1.94, 1.91, + 1.7, 1.76, 1.77, 1.83, 2.04, 1.91, 1.99, 1.99, 2.07, 2.02, 2.04, 2.1, 2.06, + 2.18, 2.21, 2.24, 2.23, 2.23, 1.98, 2.2, 2.18, 2.18, 2.21, 2.23, 2.24, 2.24, + 2.25, 1.8, 2.24, 1.73, 1.73, 2.27, 1.67, 2.21, 1.72, 2.23, 2.23, 2.23, 2.24, + 2.23, 2.12, 2.17, 1.74, 2.02, 1.88, 1.67, 1.73, 1.83, 1.82, 1.73, 1.83, 2.19, + 1.84, 1.89, 1.6, 1.71, 1.86, 1.85, 1.84, 1.87, 1.91, 1.52, 1.95, 1.87, 1.89, + 1.91, 1.91, 1.93, 1.9, 1.91, 1.9, 1.89, 1.89, 1.91, 1.9, 1.91, 1.91, 1.91, + 1.93, 1.94, 1.91, 1.92, 1.77, 1.91, 1.95, 1.19, 1.96, 1.98, 1.94, 1.55, 1.91, + 1.92, 1.92, 1.97, 1.93, 1.99, 1.86, 1.12, 1.93, 1.92, 1.95, 1.85, 1.84, 1.91, + 1.12, 1.82, 1.82, 1.95, 1.24, 1.94, 1.96, 1.21, 1.83, 1.96, 1.36, 1.96, 1.82, + 1.92, 1.68, 1.93, 1.23, 1.96, 1.93, 1.86, 1.41, 1.16, 1.6, 1.25, 1.2, 1.65, + 1.66, 1.87, 1.94, 1.96, 1.91, 1.25, 1.93, 1.91, 1.7, 0.99, 1.81, 1.92, 1.95, + 1.5, 1.47, 1.15, 1.58, 1.18, 1.82, 1.13, 1.83, 1.91, 1.26, 1.27, 1.91, 1.45, + 1.6, 1.29, 1.94, 1.94, 1.23, 1.95, 1.21, 1.94, 1.86, 1.9, 1.33, 1.75, 2.02, + 1.98, 2.03, 1.83, 1.5, 2.04, 2.02, 1.9, 2, 2.02, 1.95, 1.93, 1.95, 1.95, 1.99, + 2, 1.94, 1.96, 1.86, 1.92, 1.88, 1.86, 1.84, 1.87, 1.77, 1.89, 1.89, 1.88, + 1.94, 1.82, 1.79, 1.86, 2.06, 2.33, 1.88, 1.86, 1.81, 1.8, 1.8, 1.86, 1.9, + 2, 2.06, 2.1, 2.2, 2, 2.16, 1.98, 1.8, 1.8, 1.85, 1.75, 2.04, 2.19, 2.14, + 2.19, 1.86, 2.1, 2.11, 2.18, 2.03, 2.28, 2.19, 2.26, 2.26, 2.21, 2.21, 2.26, + 2.33, 2.27, 2.21, 2.12, 2.23, 2.26, 2.25, 1.88, 2.26, 2.24, 2.36, 2.29, 2.35, + 2.3, 2.27, 2.08, 2.05, 2.27, 2.28, 2.27, 2.28, 1.97, 2.25, 2.25, 2.25, 2.31, + 2.28, 2.27, 2.13, 2.24, 2.28, 2.28, 2.41, 2.34, 9.32, 2.28, 2.38, 2.27, 2.27, + 2.39, 2.11, 2.09, 2.1, 2.06, 2.12, 2.08, 2, 1.93, 2.02, 2.55, 1.54, 1.64, + 1.51, 1.55, 2.82, 2.92, 2.55, 2.37, 1.85, 1.6, 1.72, 1.74, 1.79, 1.9, 1.94, + 2, 2.04, 2.08, 2.12, 2.13, 2.16, 2.18, 2.18, 2.2, 2.2, 2.41, 2.39, 2.38, 2.4, + 2.42, 2.41, 2.43, 2.45, 2.43, 2.45, 2.43, 2.4, 2.44, 2.4, 2.42, 2.43, 2.45, + 2.45, 2.45, 2.46, 2.45, 2.45, 2.43, 2.51, 2.48, 2.48, 2.53, 2.46, 2.49, 2.5, + 2.5, 2.5, 2.52, 2.52, 2.54, 2.5, 2.48, 2.5, 2.55, 2.5, 2.48, 2.5, 2.5, 2.52, + 2.52, 2.48, 2.5, 2.5, 2.52, 2.46, 2.53, 9] + + # Step 4: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 5-56 + action: + name: reject + name: reduce obs space + + # Step 5: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: MetaData/fractionOfClearPixelsInFOV + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reject + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 6: Wavenumber Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 7024, 7027, 7029, 7032, 7038, 7043, 7046, 7049, 7069, 7072, 7076, + 7081, 7084, 7089, 7099, 7209, 7222, 7231, 7235, 7247, 7267, 7269, 7284, 7389, + 7419, 7423, 7424, 7426, 7428, 7431, 7436, 7444, 7475, 7549, 7584, 7665, 7666, + 7831, 7836, 7853, 7865, 7885, 7888, 7912, 7950, 7972, 7980, 7995, 8007, 8015, + 8055, 8078 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: water_area_fraction@GeoVaLs + minvalue: 1.0e-12 + action: + name: reject + + # Step 7: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorWavenumIR@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 9: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 10: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 11: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, + 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, -1, -1, + -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, -1, + 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, -1, -1, + 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, 1, 1, + 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, -1, -1, + 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, -1, 1, -1, + 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, 1, 1, -1, + -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, 1, + -1, 1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, -1, -1, -1, -1, -1, 1, -1, 1, -1, + 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, + -1, -1, 1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, + -1, -1, -1, -1, -1, 1, 1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, + -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1] + use_flag_clddet: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, + 1, -1, 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, -1, 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, + -1, -1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, + 1, 1, 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, + -1, -1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, + 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, + -1, 1, -1, 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, + 1, 1, -1, -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, + -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 12: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: NearSSTRetCheckIR@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, + 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, -1, -1, + -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, -1, + 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, -1, -1, + 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, 1, 1, + 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, -1, -1, + 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, -1, 1, -1, + 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, 1, 1, -1, + -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, 1, + -1, 1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, -1, -1, -1, -1, -1, 1, -1, 1, -1, + 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, + -1, -1, 1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, + -1, -1, -1, -1, -1, 1, 1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, + -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1] + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 13: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 14: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 4.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 4.0, 4.0, 3.5, + 2.5, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 3.5, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, + 2.0, 2.0, 2.0, 2.5, 2.0, 2.5, 2.5, 3.0, 2.5, 2.5, 2.5, 2.5, 3.5, 2.5, 2.5, + 3.0, 3.5, 3.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.5, 4.5, 4.5, 4.5, 4.5, 4.0, + 4.5, 4.0, 4.0, 4.5, 2.5, 3.0, 2.5, 3.0, 2.5, 3.0, 2.0, 2.5, 2.5, 3.0, 3.0, + 2.5, 3.0, 3.0, 3.0, 2.5, 2.5, 4.0, 4.5, 4.5, 5.0, 4.0, 4.0, 5.0, 5.0, 5.0, + 5.0, 5.5, 5.5, 4.0, 5.0, 4.0, 4.5, 5.5, 5.5, 6.0, 4.5, 4.5, 4.0, 5.0, 5.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 5.5, 4.5, 6.0, 5.0, 5.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 4.0, 6.0, 6.0, 6.0, 6.0, 4.5, 6.0, 6.0, 4.5, + 6.0, 6.0, 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 5.0, 6.0, 5.0, + 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, + 6.0, 6.0, 6.0, 6.0, 6.0] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 15: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, -1, -1, -1, 1, -1, -1, -1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, + 1, 1, -1, 1, 1, 1, -1, -1, 1, 1, -1, 1, -1, 1, -1, 1, -1, -1, -1, -1, -1, + -1, -1, -1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, -1, + 1, 1, 1, 1, -1, 1, 1, 1, 1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, -1, -1, + 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, 1, 1, 1, + 1, 1, 1, -1, 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, 1, -1, 1, 1, -1, -1, -1, + 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, 1, -1, 1, 1, 1, 1, 1, 1, 1, + 1, 1, 1, 1, -1, 1, -1, 1, -1, 1, 1, -1, -1, 1, 1, 1, -1, 1, 1, -1, 1, -1, + 1, -1, -1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, -1, -1, -1, 1, 1, 1, -1, + -1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, 1, -1, 1, 1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, 1, -1, 1, -1, 1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, 1, + -1, 1, 1, -1, 1, 1, 1, 1, 1, -1, -1, 1, -1, -1, -1, -1, -1, 1, -1, 1, -1, + 1, -1, -1, -1, 1, 1, 1, 1, 1, 1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, 1, + -1, -1, 1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, + -1, -1, -1, -1, -1, 1, 1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, 1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, -1, -1, 1, + -1, -1, -1, -1, -1, -1, 1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, + -1, -1, -1, -1, -1, -1, -1, -1, -1] + minvalue: 1.0e-12 + action: + name: reject + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_abi_goes-16.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_abi_goes-16.yaml.j2 new file mode 100644 index 000000000..8434d44ee --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_abi_goes-16.yaml.j2 @@ -0,0 +1,611 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 240 (GOES SWIR): Assigned all dummy values in prepobs_errtable.global + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + # Type 245 (GOES LWIR): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 245 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + # Type 246 (GOES cloud-top WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + # Type 247 (GOES clear-sky WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + # Type 251 (GOES VIS): Assigned all dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 251 (VIS) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # Reject obs with pressure < 12500 pa --- obs tosed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 12500. + action: + name: reject + + # Exclude data over non-water surface type where latitude > 20N for Type 240 (IRSW) and Type 245 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240, 245 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 90. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 90. + maxvalue: 100. + action: + name: reject + + # Reject obs with pressure < 15000 pa. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 15000. + action: + name: reject + + # Reject obs with pressure < 70000 pa. when Type=251 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 251 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # Reject obs with pressure > 30000. when Type=246 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 246 + test variables: + - name: MetaData/pressure + maxvalue: 30000. + action: + name: reject + + # Reject obs with pressure > 85000. when isli=1 (land surface) + # Notes: Replace land_type_index_NPOESS with land_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: GeoVaLs/land_area_fraction + minvalue: 0.99 + test variables: + - name: MetaData/pressure + maxvalue: 85000. + action: + name: reject + + # Reject obs with pct1 (Coeff. of Var.) outside of 0.04–0.5, Type [240,245,246,251] ONLY + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 240, 245, 246, 251 + test variables: + - name: MetaData/coefficientOfVariation + minvalue: 0.04 + maxvalue: 0.5 + action: + name: reject + + # NESDIS obs are also subject to the experr_norm test defined as: + # + # if (10. - 0.1*(expectedError))/(ob_speed)>0.9, or ob_speed<0.1, reject, applies to NESDIS winds + # + # CLEARED: With caveat that float precision/handling differences can generate different acceptance criteria + # between UFO and GSI for observations with an experr_norm value right around the maxvalue. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: ObsFunction/SatWindsErrnormCheck + maxvalue: 0.9 + action: + name: reject + + # Reject all Type=240 (GOES SWIR) AMVs: These are not currently assimilated in GSI and they have missing-values + # assigned to ob-errors + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # GOES IR (245) reject when pressure between 399 and 801 mb. + # # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 39901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 245 + action: + name: reject + + # GOES WV (246, 250, 254), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246, 250, 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # GOES (247) reject any observation with a /=0 surface type (non-water + # surface) within 110 hPa of the surface pressure (as part of the LNVD # check). + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # Notes (eliu): Replace land_type_index_NPOESS with land_area_fraction. + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 247 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -11000. # within 110 hPa above surface pressure, negative p-diff + action: + name: reject + + # Reject GOES (247) when difference of wind direction is more than 50 degrees. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + test variables: + - name: ObsFunction/WindDirAngleDiff + maxvalue: 50. + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_abi_goes-18.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_abi_goes-18.yaml.j2 new file mode 100644 index 000000000..b8dabb474 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_abi_goes-18.yaml.j2 @@ -0,0 +1,610 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 240 (GOES SWIR): Assigned all dummy values in prepobs_errtable.global + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + # Type 245 (GOES LWIR): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 245 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + # Type 246 (GOES cloud-top WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + # Type 247 (GOES clear-sky WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + # Type 251 (GOES VIS): Assigned all dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 251 (VIS) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # Reject obs with pressure < 12500 pa --- obs tosed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 12500. + action: + name: reject + + # Exclude data over non-water surface type where latitude > 20N for Type 240 (IRSW) and Type 245 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240, 245 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 90. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 90. + maxvalue: 100. + action: + name: reject + + # Reject obs with pressure < 15000 pa. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 15000. + action: + name: reject + + # Reject obs with pressure < 70000 pa. when Type=251 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 251 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # Reject obs with pressure > 30000. when Type=246 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 246 + test variables: + - name: MetaData/pressure + maxvalue: 30000. + action: + name: reject + + # Reject obs with pressure > 85000. when isli=1 (land surface) + # Notes: Replace land_type_index_NPOESS with land_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: GeoVaLs/land_area_fraction + minvalue: 0.99 + test variables: + - name: MetaData/pressure + maxvalue: 85000. + action: + name: reject + + # Reject obs with pct1 (Coeff. of Var.) outside of 0.04–0.5, Type [240,245,246,251] ONLY + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 240, 245, 246, 251 + test variables: + - name: MetaData/coefficientOfVariation + minvalue: 0.04 + maxvalue: 0.5 + action: + name: reject + + # NESDIS obs are also subject to the experr_norm test defined as: + # + # if (10. - 0.1*(expectedError))/(ob_speed)>0.9, or ob_speed<0.1, reject, applies to NESDIS winds + # + # CLEARED: With caveat that float precision/handling differences can generate different acceptance criteria + # between UFO and GSI for observations with an experr_norm value right around the maxvalue. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: ObsFunction/SatWindsErrnormCheck + maxvalue: 0.9 + action: + name: reject + + # Reject all Type=240 (GOES SWIR) AMVs: These are not currently assimilated in GSI and they have missing-values + # assigned to ob-errors + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # GOES IR (245) reject when pressure between 399 and 801 mb. + # # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 39901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 245 + action: + name: reject + + # GOES WV (246, 250, 254), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246, 250, 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # GOES (247) reject any observation with a /=0 surface type (non-water + # surface) within 110 hPa of the surface pressure (as part of the LNVD # check). + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # Notes (eliu): Replace land_type_index_NPOESS with land_area_fraction. + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 247 + reference: GeoVaLs/surface_pressure + value: MetaData/pressure + maxvalue: -11000. # within 110 hPa above surface pressure, negative p-diff + action: + name: reject + + # Reject GOES (247) when difference of wind direction is more than 50 degrees. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + test variables: + - name: ObsFunction/WindDirAngleDiff + maxvalue: 50. + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_ahi_h8.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_ahi_h8.yaml.j2 new file mode 100644 index 000000000..fc609d96b --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_ahi_h8.yaml.j2 @@ -0,0 +1,442 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI"s thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 242 (Himawari VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 242 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + # Type 250 (Himawari AHI WV, cloud-top or clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 250 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 7., 7.3, 7.6, 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., + 8., 8., 8.] + # Type Type 252 (Himawari AHI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 252 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 250 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 250 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. (also > 100., which is missing data) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + + # Reject Type 252 (IR) winds with a /=0 surface type (non-water surface) when latitude > 20. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 252 + test variables: + - name: MetaData/latitude + maxvalue: 20. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # IR (Type 242), reject when pressure is less than 700 mb + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 242 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # cloud-top WV (Type 250), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 250 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # JMA IR (252) reject when pressure between 499 and 801 mb. + # PERFORM ACTION: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 49901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 252 + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_leogeo_multi.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_leogeo_multi.yaml.j2 new file mode 100644 index 000000000..c5e2b0497 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_leogeo_multi.yaml.j2 @@ -0,0 +1,270 @@ +- obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 255 (LEOGEO LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 255 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_viirs_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_viirs_n20.yaml.j2 new file mode 100644 index 000000000..f7d577a15 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_viirs_n20.yaml.j2 @@ -0,0 +1,298 @@ +- obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 260 (VIIRS LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 260 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/surface_pressure + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters + + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_viirs_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_viirs_npp.yaml.j2 new file mode 100644 index 000000000..7dd263716 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_amv_viirs_npp.yaml.j2 @@ -0,0 +1,298 @@ +- obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 260 (VIIRS LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 260 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/surface_pressure + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters + +# ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_osw_ascat_metop-b.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_osw_ascat_metop-b.yaml.j2 new file mode 100644 index 000000000..8a9afdee7 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_osw_ascat_metop-b.yaml.j2 @@ -0,0 +1,323 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + # Use height vertical coordinate first + # vertical coordinate: geometric_height + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + hofx scaling field: SurfaceWindScalingHeight + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + - filter: Gaussian Thinning + horizontal_mesh: 75 + use_reduced_horizontal_grid: true + round_horizontal_bin_count_to_nearest: true + partition_longitude_bins_using_mesh: true + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for rescaled height coordinate + - filter: Variable Transforms + Transform: AdjustedHeightCoordinate + SkipWhenNoObs: false + + # Apply variable changes needed for wind scaling + - filter: Variable Transforms + Transform: SurfaceWindScalingHeight + SkipWhenNoObs: false + + # Assign the initial observation error (constant value, 1.5 m/s right now). + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 1.5 + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + # Reject all obs with PreQC mark already set above 3 + # NOTE: All scatwinds have an automatic PreQC mark of 2 (hard-wired default from GSI) + # - filter: PreQC + # maxvalue: 3 + # action: + # name: reject + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Reject all ASCAT (Type 290) winds with tsavg <= 273.0 (surface temperature) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + # - variable: GeoVaLs/surface_temperature + - variable: GeoVaLs/skin_temperature_at_surface_where_land + maxvalue: 273. + action: + name: reject + + # Reject all ASCAT (Type 290) winds with isflg /= 0 (non-water surface) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + - variable: GeoVaLs/water_area_fraction + maxvalue: 0.99 + action: + name: reject + + # Reject ASCAT (Type 290) when observed component deviates from background by more than 5.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windEastward + - name: HofX/windEastward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windNorthward + - name: HofX/windNorthward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + # Reject OSCAT (Type 291) when observed component deviates from background by more than 6.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Background Check + filter variables: + - name: windEastward + - name: windNorthward + threshold: 6. + absolute threshold: 6. + where: + - variable: ObsType/windEastward + is_in: 291 + action: + name: reject + + # Reject ASCAT (Type 290) when ambiguity check fails (returned value is negative) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + test variables: + - name: ObsFunction/ScatWindsAmbiguityCheck + options: + minimum_uv: 0.0001 # hard-coding a minimum-uv for transparancy, want this to basically be zero + maxvalue: 0. + action: + name: reject + + # All scatwinds must adjust errors based on ObsErrorFactorPressureCheck. + # This check will inflate errors for obs that are too close to either + # the model top or bottom. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All scatwinds subject to a gross error check. This is contained within + # the WindsSPDBCheck, although it is not exclusive to satwinds. + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # There is no across-the-board inflation for nvqc=.true. for scatwinds, presumably because for + # this inflation to take place both nvqc must be .true. AND ibeta must be >0, see: + # https://github.com/NOAA-EMC/GSI/blob/14ae595af1b03471287d322596d35c0665336e95/src/gsi/setupw.f90#L1229 + # GSI settings must have ibeta>0 for satwinds, but not for scatwinds. + # + # If the ibeta settings for scatwinds were to change while nvqc remained .true., we would extend YAML to + # an additional filter that inflates final ob-errors across-the-board by 1/0.8 = 1.25. NOTE: the nvqc setting + # is defaulted to .false. in GSI code, but is overridden in global operational configuration. See: + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this functionality were to be activated for scatwinds, you would want to include this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + # END OF FILTERS# + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_ozone_ompsnp_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_ozone_ompsnp_npp.yaml.j2 new file mode 100644 index 000000000..ff078f37c --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_ozone_ompsnp_npp.yaml.j2 @@ -0,0 +1,341 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsgrouping: + group variables: ["latitude"] + sort variable: "pressure" + sort order: "ascending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneLayer] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [22] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: false + stretchVertices: none #options: top, bottom, topbottom, none + # model units coeff: 2.240013904035E-3 # this number to match the gsihofx values + model units coeff: 2.241398632746E-3 # this number to match the gsihofx values (use this) + # the actual scientific conversion factor is + # 2.1415E-3 kg[O3]/m-2 to DU + # so the name of the geovals + # is also likely wrong, as it apprears to be a mass + # fraction given the conversion factor needed + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Observation error assignment + - filter: Perform Action + filter variables: + - name: ozoneLayer + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [0.001, 10.1325, 16.00935, 25.43258, 40.32735, 63.93607, 101.325, + 160.0935, 254.3257, 403.2735, 639.3608, 1013.25, 1600.935, 2543.258, 4032.735, + 6393.607, 10132.5, 16009.35, 25432.57, 40327.35, 63936.07, 101325] + # errors: [7.7236, 0.020, 0.020, 0.025, 0.080, 0.150, 0.056, 0.125, 0.200, + # 0.299, 0.587, 0.864, 1.547, 2.718, 3.893, 4.353, 3.971, 4.407, 4.428, + # 3.312, 2.198, 2.285] + errors: [7.7236, 0.020, 0.020, 0.025, 0.040, 0.080, 0.156, 0.245, 0.510, + 1.098, 3.917, 6.124, 6.347, 5.798, 6.843, 9.253,10.091,10.967, 8.478, + 5.572, 2.638, 3.525] # operational from gfs.v16.3.9 (late 2023) + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Do not assimilation where pressure is zero + # Zero pressure indicates the data is total column ozone + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/pressure + maxvalue: 0.0001 + + # Sanity check on observaton values + - filter: Bounds Check + filter variables: + - name: ozoneLayer + minvalue: 0 + maxvalue: 1000 + action: + name: reject + + # Total Ozone Quality Check (keeps 0, 2) + # 0 indentifies good data + # 2 identifies good data with a solar zenith angle > 84 degrees + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/totalOzoneQuality + is_not_in: 0, 2 + + # Profile Ozone Quality Check (keeps 0, 1, 7) + # 0 : good data + # 1 : good data with a solar zenith angle > 84 degrees + # 7 : profile for which stray light correction applied + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/profileOzoneQuality + is_not_in: 0, 1, 7 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Gross error check + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 120 + action: + name: reject + where: + - variable: + name: MetaData/pressure + maxvalue: 0.001 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 30 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 30000.0 + maxvalue: 110000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 40 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 20000.0 + maxvalue: 30000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 44.42 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 10100.0 + maxvalue: 20000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 57.52 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 6400.0 + maxvalue: 10100.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 69.4 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 4000.0 + maxvalue: 6400.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 70 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 2600.0 + maxvalue: 4000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 62.73 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 1600.0 + maxvalue: 2600.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 50.52 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 1100.0 + maxvalue: 1600.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 35.9 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 700.0 + maxvalue: 1100.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 26.41 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 400.0 + maxvalue: 700.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 20.51 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 300.0 + maxvalue: 400.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 12.82 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 200.0 + maxvalue: 300.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 10 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 70.0 + maxvalue: 200.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 5 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 40.0 + maxvalue: 70.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 2 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 30.0 + maxvalue: 40.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 1 + action: + name: reject + where: + - variable: + name: MetaData/pressure + maxvalue: 30.0 + + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_ozone_ompstc_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_ozone_ompstc_npp.yaml.j2 new file mode 100644 index 000000000..a6ed761e3 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/retrieval_ozone_ompstc_npp.yaml.j2 @@ -0,0 +1,142 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneTotal] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [1] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: true + stretchVertices: topbottom # options: top, bottom, topbottom, none + model units coeff: 2.241398632746E-3 + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # assign observation error + - filter: Perform Action + filter variables: + - name: ozoneTotal + action: + name: assign error + error parameter: 6.0 + + # GSI read routine QC + # range sanity check + - filter: Bounds Check + filter variables: + - name: ozoneTotal + minvalue: 0 + maxvalue: 1000 + action: + name: reject + + #- filter: Gaussian Thinning + # horizontal_mesh: 150 + # use_reduced_horizontal_grid: true + # distance_norm: geodesic + # action: + # name: reject + + # Accept total_ozone_error_flag values of 0 and 1, but not any others. + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/totalOzoneQualityCode + is_not_in: 0, 1 + + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/bestOzoneAlgorithmFlag + is_in: 3, 13 + + # GSI setup routine QC + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 1, 2, 3, 4, 35 + - variable: + name: MetaData/latitude + minvalue: 50.0 + + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 1, 2, 3, 4, 35 + - variable: + name: MetaData/latitude + maxvalue: -50.0 + + - filter: Gaussian Thinning + horizontal_mesh: 150 + use_reduced_horizontal_grid: true + distance_norm: geodesic + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + - filter: Background Check + filter variables: + - name: ozoneTotal + threshold: 10.0 + absolute threshold: 300.0 + action: + name: reject + + # End of Filters + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere-lgetkf/sondes.yaml.j2 b/parm/jcb-gdas/observations/atmosphere-lgetkf/sondes.yaml.j2 new file mode 100644 index 000000000..3064438f6 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere-lgetkf/sondes.yaml.j2 @@ -0,0 +1,59 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + distribution: + name: "{{distribution_type}}" + halo size: 1250e3 + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward, airTemperature] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + + # Observation Error + # ----------------- + obs error: + covariance model: diagonal + + # Observation Filters (QC) + # ------------------------ + obs filters: + - filter: PreQC + maxvalue: 3 + - filter: Background Check + filter variables: + - name: windEastward + - name: windNorthward + - name: airTemperature + threshold: 2.0 + + # Observation Localizations (LocalEnsembleDA) + # ------------------------------------------- + obs localizations: + - localization method: Horizontal Gaspari-Cohn + lengthscale: 1250e3 + max nobs: 10000 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/aircraft.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/aircraft.yaml.j2 new file mode 100644 index 000000000..92334a3dd --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/aircraft.yaml.j2 @@ -0,0 +1,767 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + obsgrouping: + group variables: [stationIdentification] + sort variable: pressure + sort order: descending + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [specificHumidity, windEastward, windNorthward, airTemperature] + + # Observation Operator + # -------------------- + obs operator: + name: Composite + components: + - name: VertInterp + variables: + - name: specificHumidity + - name: airTemperature + - name: VertInterp + variables: + - name: windEastward + - name: windNorthward + # Hofx scaling + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Composite + components: + - name: VertInterp + variables: + - name: specificHumidity + - name: airTemperature + - name: VertInterp + variables: + - name: windEastward + - name: windNorthward + + # Hofx scaling + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_acft_suffix}}" + variables without bc: [specificHumidity, windEastward, windNorthward] + bc by record: true + variational bc: + predictors: + - name: constant + - name: obsMetadataPredictor + variable: instantaneousAltitudeRate + - name: obsMetadataPredictor + variable: instantaneousAltitudeRate + order: 2 + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_acft_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + + + obs pre filters: + + # Assign the initial observation error, based on pressure (for AIREP/ACARS; itype=130) + # (for AMDAR itype = 131, and for Canadian AMDAR itype=135) + - filter: Perform Action + filter variables: + - name: specificHumidity + where: + - variable: + name: ObsType/specificHumidity + is_in: 130, 131, 135 + action: + name: reject + #defer to post: true + + # Assign the initial observation error, based on pressure (for RECON aircraft; itype=132) + - filter: Perform Action + filter variables: + - name: specificHumidity + action: + name: assign error + error parameter: 0.2 + where: + - variable: + name: ObsType/specificHumidity + is_in: 132 + + + # Assign the initial observation error, based on pressure (for MDCRS; itype=133) + - filter: Perform Action + filter variables: + - name: specificHumidity + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000, 105000, 100000, 95000, 90000, 85000, 80000, 75000, 70000, 65000, 60000, 55000, 50000, 45000, 40000, 35000, 30000, 25000, 20000, 15000, 10000, 7500, 5000, 4000, 3000] + errors: [.19455, .19062, .18488, .17877, .17342, .16976, .16777, .16696, .16605, .16522, .16637, .17086, .17791, .18492, .18996, .19294, .19447, .19597, .19748, .19866, .19941, .19979, .19994, .19999, .20] + where: + - variable: + name: ObsType/specificHumidity + is_in: 133 + + # Assign the initial observation error, based on pressure (for TAMDAR itype=134) + - filter: Perform Action + filter variables: + - name: specificHumidity + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000, 75000] + errors: [0.2, 1000000000.0 ] + where: + - variable: + name: ObsType/specificHumidity + is_in: 134 + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/specificHumidity + type: int + source variable: QualityMarker/specificHumidity + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/specificHumidity + type: int + value: 0 + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/specificHumidity + type: int + value: 101 + where: + - variable: PreQC/specificHumidity + is_in: 8-15 + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/specificHumidity + type: int + value: 100 + where: + - variable: ObsType/specificHumidity + is_in: 130,131,134,135 + + # Inflate if QC == 3 or 7 + - filter: Perform Action + filter variables: + - name: specificHumidity + action: + name: inflate error + inflation factor: 1.2 + where: + - variable: PreQC/specificHumidity + is_in: 3,7 + + # Assign intial ObsError specific to AIREP/ACARS + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 3.6 + where: + - variable: + name: ObsType/windEastward + is_in: 230 + + # Assign intial ObsError specific to AMDAR + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 3.0 + where: + - variable: + name: ObsType/windEastward + is_in: 231 + + # Assign intial ObsError specific to MDCRS + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 2.5 + where: + - variable: + name: ObsType/windEastward + is_in: 233 + + # Assign intial ObsError specific to TAMDAR, Canadian AMDAR + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 3.0 + where: + - variable: + name: ObsType/windEastward + is_in: 234, 235 + + # Assign the initial ObsError, based on height/pressure for RECON aircraft + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000, 70000, 65000, 60000, 55000, 50000, 45000, 40000, 35000, 30000, 25000, 20000, 15000, 10000, 7500, 5000] + errors: [2.4, 2.4, 2.5, 2.6, 2.7, 2.8, 2.95, 3.1, 3.25, 3.4, 3.175, 2.95, 2.725, 2.5, 2.6, 2.7] + where: + - variable: + name: ObsType/windEastward + is_in: 232 + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/windNorthward + type: int + source variable: QualityMarker/windNorthward + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/windEastward + type: int + source variable: QualityMarker/windEastward + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/windNorthward + type: int + value: 0 + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/windEastward + type: int + value: 0 + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/windNorthward + type: int + value: 101 + where: + - variable: PreQC/windNorthward + is_in: 8-15 + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/windEastward + type: int + value: 101 + where: + - variable: PreQC/windEastward + is_in: 8-15 + + # Error inflation when QC is 3 or 7 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: inflate error + inflation factor: 1.2 + where: + - variable: PreQC/windNorthward + is_in: 3,7 + + # Error inflation when observation pressure < 50 hPa (read_prepbufr.f90) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: inflate error + inflation factor: 1.2 + where: + - variable: MetaData/pressure + maxvalue: 5000.0 + + # Error assignments + # Assign the initial observation error, based on pressure (for AIREP/ACARS; itype=130) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 80000] + errors: [2.5, 2.3, 2.1, 1.9, 1.7] + where: + - variable: + name: ObsType/airTemperature + is_in: 130 + + # Assign the initial observation error, based on pressure (for AMDAR and MDCRS; itype=131,133) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 80000] + errors: [1.4706, 1.3529, 1.2353, 1.1176, 1.0] + where: + - variable: + name: ObsType/airTemperature + is_in: 131,133 + + # Assign the initial observation error, based on pressure (for RECON aircraft; itype=132) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000, 100000, 95000, 90000, 85000, 35000, 30000, 25000, 20000, 15000, 10000, 7500, 5000, 4000, 3000, 2000, 1000] + errors: [ 1.2, 1.2, 1.1, 0.9, 0.8, 0.8, 0.9, 1.2, 1.2, 1.0, 0.8, 0.8, 0.9, 0.95, 1.0, 1.25, 1.5] + where: + - variable: + name: ObsType/airTemperature + is_in: 132 + + # Assign the initial observation error, based on pressure (for TAMDAR itype=134) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 80000, 60000, 40000, 7500] + errors: [1.5, 1.35, 1.25, 1.10, 1.0, 1.3, 1.7, 1000000000.0 ] + where: + - variable: + name: ObsType/airTemperature + is_in: 134 + + # Assign the initial observation error, based on pressure (for Canadian AMDAR itype=135) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [100000, 95000, 90000, 85000, 80000] + errors: [1.4706, 1.3529, 1.2353, 1.1176, 1.0 ] + where: + - variable: + name: ObsType/airTemperature + is_in: 135 + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/airTemperature + type: int + source variable: QualityMarker/airTemperature + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/airTemperature + type: int + value: 0 + + - filter: Variable Assignment + assignments: + - name: PreUseFlag/airTemperature + type: int + value: 101 + where: + - variable: PreQC/airTemperature + is_in: 8-15 + + + # Reassign any AIREP/PIREP (type=130) airTemperature MetaData/stationIdentification to 'KX130 ' + - filter: Variable Assignment + where: + - variable: + name: ObsType/airTemperature + is_in: 130 + assignments: + - name: MetaData/stationIdentification + value: "KX130" + + # Error inflation where QC is 3 or 7 + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: inflate error + inflation factor: 1.2 + where: + - variable: PreQC/airTemperature + is_in: 3,7 + + # Error inflation when observation pressure < 100 mb (read_prepbufr.f90) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: inflate error + inflation factor: 1.2 + where: + - variable: MetaData/pressure + maxvalue: 10000.0 + + # Inflate error by 10 if kx==130 and P >=500 mb (read_prepbufr.f90) + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: inflate error + inflation factor: 10.0 + where: + - variable: ObsType/airTemperature + is_in: 130.0 + - variable: MetaData/pressure + minvalue: 50000.0 + + # Inflate if IALR > 30 + - filter: Perform Action + filter variables: + - name: airTemperature + action: + name: inflate error + inflation factor: 1.5 + where: + - variable: MetaData/instantaneousAltitudeRate + minvalue: 30.0 + + + obs prior filters: + + # Calculates ratio_errors from GSI + # Error inflation based on pressure check + - filter: Perform Action + filter variables: + - name: specificHumidity + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: specificHumidity + inflation factor: 8.0 + request_saturation_specific_humidity_geovals: true + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + + + # Apply variable changes needed for performing wind scaling + # --------------------------------------------------------- + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: True + + + # Error inflation based on pressure check + - filter: Perform Action + filter variables: + - name: windEastward + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windEastward + inflation factor: 4.0 + surface_obs: false + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + defer to post: true + + # Error inflation based on pressure check + - filter: Perform Action + filter variables: + - name: windNorthward + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + surface_obs: false + #test_obserr: GsiAdjustObsError + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + defer to post: true + + + # error inflation based on pressure check + - filter: Perform Action + filter variables: + - name: airTemperature + where: + - variable: + name: ObsType/airTemperature + is_in: 130-135 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: airTemperature + inflation factor: 8.0 + surface_obs: true + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + defer to post: true + + + obs post filters: + + # Background check + # ratio threshold 8.0 + - filter: Background Check + test_hofx: HofX + filter variables: + - name: specificHumidity + threshold: 8.0 + action: + name: reject + where: + - variable: PreQC/specificHumidity + is_not_in: 3,7 + defer to post: true + + # ratio threshold * 0.7 if PreQC=3 + - filter: Background Check + test_hofx: HofX + filter variables: + - name: specificHumidity + threshold: 5.6 + action: + name: reject + where: + - variable: PreQC/specificHumidity + is_in: 3,7 + defer to post: true + + + # Reject where QC > 8 + - filter: Perform Action + filter variables: + - name: specificHumidity + where: + - variable: PreQC/specificHumidity + is_in: 9-15 + action: + name: reject + + # Gross Check + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 230, 231, 232, 233, 234, 235 ] + cgross: [ 6.0, 6.5, 7.0, 7.5, 7.5, 7.5 ] + error_min: [ 1.4, 1.4, 1.4, 1.4, 1.4, 1.4 ] + error_max: [ 6.1, 6.1, 6.1, 6.1, 6.1, 6.1 ] + variable: windEastward + where: + - variable: PreQC/windEastward + is_not_in: 3 + action: + name: reject + defer to post: true + + # Gross Check + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 230, 231, 232, 233, 234, 235 ] + cgross: [ 4.2, 4.55, 4.9, 5.25, 5.25, 5.25 ] + error_min: [ 1.4, 1.4, 1.4, 1.4, 1.4, 1.4 ] + error_max: [ 6.1, 6.1, 6.1, 6.1, 6.1, 6.1 ] + variable: windEastward + where: + - variable: PreQC/windEastward + is_in: 3 + action: + name: reject + defer to post: true + + # Gross Check + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 230, 231, 232, 233, 234, 235 ] + cgross: [ 6.0, 6.5, 7.0, 7.5, 7.5, 7.5 ] + error_min: [ 1.4, 1.4, 1.4, 1.4, 1.4, 1.4 ] + error_max: [ 6.1, 6.1, 6.1, 6.1, 6.1, 6.1 ] + variable: windNorthward + where: + - variable: PreQC/windNorthward + is_not_in: 3 + action: + name: reject + defer to post: true + + # Gross Check + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 230, 231, 232, 233, 234, 235 ] + cgross: [ 4.2, 4.55, 4.9, 5.25, 5.25, 5.25 ] + error_min: [ 1.4, 1.4, 1.4, 1.4, 1.4, 1.4 ] + error_max: [ 6.1, 6.1, 6.1, 6.1, 6.1, 6.1 ] + variable: windNorthward + where: + - variable: PreQC/windNorthward + is_in: 3 + action: + name: reject + defer to post: true + + + # Reject where QC is 9-15 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: PreQC/windNorthward + is_in: 9-15 + action: + name: reject + defer to post: true + + - filter: Variable Assignment + assignments: + - name: HofXBc/airTemperature + type: float + function: + name: ObsFunction/LinearCombination + options: + variables: [HofX/airTemperature] + coefs: [1.0] + defer to post: true + + # Background check + # ratio threshold 7.0 + - filter: Background Check + test_hofx: HofXBc + filter variables: + - name: airTemperature + threshold: 7.0 + action: + name: reject + where: + - variable: PreQC/airTemperature + is_not_in: [3] + defer to post: true + + # ratio threshold * 0.7 if PreQC=3 + - filter: Background Check + test_hofx: HofXBc + filter variables: + - name: airTemperature + threshold: 4.9 + action: + name: reject + where: + - variable: PreQC/airTemperature + is_in: [3] + defer to post: true + + # Reject where QC = 4-19 + - filter: Perform Action + filter variables: + - name: airTemperature + where: + - variable: PreQC/airTemperature + is_in: 4-19 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 8061 #specificHumidity + #passedBenchmark: 227312 #windNorthward and windEastward + #passedBenchmark: 114568 #airTemperature diff --git a/parm/jcb-gdas/observations/atmosphere/conventional_ps.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/conventional_ps.yaml.j2 new file mode 100644 index 000000000..f870262ad --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/conventional_ps.yaml.j2 @@ -0,0 +1,369 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure] + + # Observation Operator + # -------------------- + obs operator: + name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + station_altitude: height + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + variables: + - name: stationPressure + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Initial Error Assignments for SFC Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [181] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [187] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [85000, 80000, 75000, 70000, 65000, 60000, 55000] + errors: [120, 140, 140, 140, 140, 140, 1.0e+11] + + # Initial Error Assignments for SFCSHIP Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [180] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [60000, 55000] + errors: [130, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [183] + action: + name: assign error + error parameter: 1.0e+11 + + # Initial Error Assignments for Radiosonde + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [120] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: InputObsError/stationPressure + type: float + source variable: ObsErrorData/stationPressure + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/stationPressure + type: int + source variable: QualityMarker/stationPressure + + # Create PreUseFlag group variable (usage in GSI read_prepbufr) + # Initialize + - filter: Variable Assignment + assignments: + - name: PreUseFlag/stationPressure + type: int + source variable: PreQC/stationPressure + + - filter: Variable Assignment + where: + - variable: + name: PreUseFlag/stationPressure + is_in: 1-15 + assignments: + - name: PreUseFlag/stationPressure + value: 0 + # Re-assignment + - filter: Variable Assignment + where: + - variable: + name: ObsType/stationPressure + is_in: 183 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: ObsValue/stationPressure + is_defined: + - variable: + name: ObsValue/stationPressure + maxvalue: 50000.00 + where operator: and + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 9, 12, 15 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 4-15 + assignments: + - name: PreUseFlag/stationPressure + value: 101 + + ## Observation range sanity check + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 37499.0 + # maxvalue: 106999.0 + # action: + # name: reject + ## Reject all ObsType 183 + #- filter: RejectList + # where: + # - variable: + # name: ObsType/stationPressure + # is_in: 183 + ## Reject surface pressure below 500 hPa + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 50000.00 + # action: + # name: reject + #- filter: RejectList + # where: + # - variable: + # name: PreQC/stationPressure + # is_in: 4-15 + # Inflate obs error based on obs type + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3, 7 + action: + name: inflate error + inflation factor: 1.2 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Calculate obs error inflation factors for duplicated observations at the same location + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorDuplicateCheck/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorDuplicateCheck + options: + use_air_pressure: false + variable: stationPressure + + # Reduce effective observation error based on obs type and subtype + # In this case: reduce effective obs error for buoy + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: + name: ObsType/stationPressure + is_in: 180 + - variable: + name: ObsSubType/stationPressure + is_in: 0 + action: + name: inflate error + inflation factor: 0.7 + + # Calculate obs error inflation factors for large discrepancies between model and observations + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSfcPressure/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorSfcPressure + options: + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + station_altitude: height + + # Inflate surface pressure observation based on discrepancies between + # model and observations due to terrian + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSfcPressure/stationPressure + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/Innovation + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/stationPressure + - name: HofX/stationPressure + coefs: [1, -1] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 5.0 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_not_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + action: + name: reject + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 3.5 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + action: + name: reject + + # Inflate obs error based on duplicate check + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorDuplicateCheck/stationPressure + + # Reject data based on PreUseFlag (usage in GSI) + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreUseFlag/stationPressure + is_not_in: 0, 1 + action: + name: reject + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro.yaml.j2 new file mode 100644 index 000000000..ed5355799 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro.yaml.j2 @@ -0,0 +1,158 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + # obsgrouping: + # group variables: [ "sequenceNumber" ] + # sort variable: "impactHeightRO" + # sort order: "ascending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Diagnostic flag for qfro + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: qfroCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + # Step 0-B: qfro Check - good: 0, reject: 1 + - filter: Bounds Check + - filter: RejectList + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 3-5,421,440,821 + test variables: + - name: MetaData/qualityFlags + minvalue: -0.1 + maxvalue: 0.1 + actions: + - name: set + flag: qfroCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #2. commgpstop + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265,266,267,268,269 + test variables: + - name: MetaData/impactHeightRO + maxvalue: 45000.1 + action: + name: reject + #3. metop below 8 km + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 3-5 + test variables: + - name: MetaData/impactHeightRO + minvalue: 8000.1 + action: + name: reject + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + #5. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + #6. Obs error inflate + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + #7. Background check + #- filter: Background Check + # filter variables: + # - name: bendingAngle + # threshold: 10 + # action: + # name: reject + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_cosmic2.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_cosmic2.yaml.j2 new file mode 100644 index 000000000..f4dd7c9ad --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_cosmic2.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_geooptics.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_geooptics.yaml.j2 new file mode 100644 index 000000000..bc4988048 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_geooptics.yaml.j2 @@ -0,0 +1,97 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. commgpstop + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265,266,267,268,269 + test variables: + - name: MetaData/impactHeightRO + maxvalue: 45000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_grace.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_grace.yaml.j2 new file mode 100644 index 000000000..5e77ca283 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_grace.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_kompsat5.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_kompsat5.yaml.j2 new file mode 100644 index 000000000..5e77ca283 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_kompsat5.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_metop.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_metop.yaml.j2 new file mode 100644 index 000000000..a3754e23d --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_metop.yaml.j2 @@ -0,0 +1,108 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using qfro + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for qfro + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: qfroCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: qfro Check - good: 0, reject: 1 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 3-5,421,440,821 + test variables: + - name: MetaData/qualityFlags + minvalue: -0.1 + maxvalue: 0.9 + actions: + - name: set + flag: qfroCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #2. metop below 8 km + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 3-5 + test variables: + - name: MetaData/impactHeightRO + minvalue: 8000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_paz.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_paz.yaml.j2 new file mode 100644 index 000000000..366df08e2 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_paz.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_planetiq.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_planetiq.yaml.j2 new file mode 100644 index 000000000..bc4988048 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_planetiq.yaml.j2 @@ -0,0 +1,97 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. commgpstop + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265,266,267,268,269 + test variables: + - name: MetaData/impactHeightRO + maxvalue: 45000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_sentinel6.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_sentinel6.yaml.j2 new file mode 100644 index 000000000..5e77ca283 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_sentinel6.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_spire.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_spire.yaml.j2 new file mode 100644 index 000000000..bc4988048 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_spire.yaml.j2 @@ -0,0 +1,97 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. commgpstop + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265,266,267,268,269 + test variables: + - name: MetaData/impactHeightRO + maxvalue: 45000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_tandemx.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_tandemx.yaml.j2 new file mode 100644 index 000000000..5e77ca283 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_tandemx.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/gnssro_terrasarx.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/gnssro_terrasarx.yaml.j2 new file mode 100644 index 000000000..5e77ca283 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/gnssro_terrasarx.yaml.j2 @@ -0,0 +1,95 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [ 'sequenceNumber' ] + sort variable: 'impactHeightRO' + sort order: 'ascending' + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + simulated variables: [bendingAngle] + + # Observation Operator + # -------------------- + obs operator: + name: GnssroBndNBAM + obs options: + use_compress: 1 + sr_steps: 2 + vertlayer: full + super_ref_qc: NBAM + output_diags: true + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Apply gross check using pccf + # Step 0-A: Create Diagnostic Flags + # Diagnostic flag for pccf + - filter: Create Diagnostic Flags + filter variables: + - name: bendingAngle + flags: + - name: pccfCheckReject + initial value: false + force reinitialization: true + + # Step 0-B: pccf Check for CDACC data - good: 0.1-100, reject: 0 + - filter: Bounds Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/satelliteIdentifier + is_in: 265-269,750-755,44,786,820,825 + test variables: + - name: MetaData/pccf + minvalue: 0.1 + maxvalue: 100.1 + actions: + - name: set + flag: pccfCheckReject + - name: reject + + #1. gpstop + - filter: Domain Check + filter variables: + - name: bendingAngle + where: + - variable: + name: MetaData/impactHeightRO + minvalue: 0 + maxvalue: 55000.1 + action: + name: reject + #3. RONBAM cut off check + - filter: Background Check RONBAM + filter variables: + - name: bendingAngle + action: + name: reject + defer to post: true + #4. assign obs error + - filter: ROobserror + filter variables: + - name: bendingAngle + errmodel: NBAM + defer to post: true + #5. Obs error inflate + - filter: Perform Action + filter variables: + - name: bendingAngle + action: + name: RONBAMErrInflate + defer to post: true + # -------------------------------- diff --git a/parm/jcb-gdas/observations/atmosphere/prepbufr_adpsfc.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/prepbufr_adpsfc.yaml.j2 new file mode 100644 index 000000000..d11297ebf --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/prepbufr_adpsfc.yaml.j2 @@ -0,0 +1,369 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure] + + # Observation Operator + # -------------------- + obs operator: + name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + station_altitude: height + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + variables: + - name: stationPressure + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Initial Error Assignments for SFC Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [181] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [187] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [85000, 80000, 75000, 70000, 65000, 60000, 55000] + errors: [120, 140, 140, 140, 140, 140, 1.0e+11] + + # Initial Error Assignments for SFCSHIP Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [180] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [60000, 55000] + errors: [130, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [183] + action: + name: assign error + error parameter: 1.0e+11 + + # Initial Error Assignments for Radiosonde + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [120] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: InputObsError/stationPressure + type: float + source variable: ObsErrorData/stationPressure + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/stationPressure + type: int + source variable: QualityMarker/stationPressure + + # Create PreUseFlag group variable (usage in GSI read_prepbufr) + # Initialize + - filter: Variable Assignment + assignments: + - name: PreUseFlag/stationPressure + type: int + source variable: PreQC/stationPressure + + - filter: Variable Assignment + where: + - variable: + name: PreUseFlag/stationPressure + is_in: 1-15 + assignments: + - name: PreUseFlag/stationPressure + value: 0 + # Re-assignment + - filter: Variable Assignment + where: + - variable: + name: ObsType/stationPressure + is_in: 183 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: ObsValue/stationPressure + is_defined: + - variable: + name: ObsValue/stationPressure + maxvalue: 50000.00 + where operator: and + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 9, 12, 15 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 4-15 + assignments: + - name: PreUseFlag/stationPressure + value: 101 + + ## Observation range sanity check + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 37499.0 + # maxvalue: 106999.0 + # action: + # name: reject + ## Reject all ObsType 183 + #- filter: RejectList + # where: + # - variable: + # name: ObsType/stationPressure + # is_in: 183 + ## Reject surface pressure below 500 hPa + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 50000.00 + # action: + # name: reject + #- filter: RejectList + # where: + # - variable: + # name: PreQC/stationPressure + # is_in: 4-15 + # Inflate obs error based on obs type + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3, 7 + action: + name: inflate error + inflation factor: 1.2 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Calculate obs error inflation factors for duplicated observations at the same location + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorDuplicateCheck/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorDuplicateCheck + options: + use_air_pressure: false + variable: stationPressure + + # Reduce effective observation error based on obs type and subtype + # In this case: reduce effective obs error for buoy + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: + name: ObsType/stationPressure + is_in: 180 + - variable: + name: MetaData/observationSubTypeNum + is_in: 0 + action: + name: inflate error + inflation factor: 0.7 + + # Calculate obs error inflation factors for large discrepancies between model and observations + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSfcPressure/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorSfcPressure + options: + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + station_altitude: height + + # Inflate surface pressure observation based on discrepancies between + # model and observations due to terrian + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSfcPressure/stationPressure + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/Innovation + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/stationPressure + - name: HofX/stationPressure + coefs: [1, -1] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 5.0 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_not_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + action: + name: reject + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 3.5 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + action: + name: reject + + # Inflate obs error based on duplicate check + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorDuplicateCheck/stationPressure + + # Reject data based on PreUseFlag (usage in GSI) + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreUseFlag/stationPressure + is_not_in: 0, 1 + action: + name: reject + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/prepbufr_adpupa.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/prepbufr_adpupa.yaml.j2 new file mode 100644 index 000000000..7d6c7190d --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/prepbufr_adpupa.yaml.j2 @@ -0,0 +1,369 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure] + + # Observation Operator + # -------------------- + obs operator: + name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + station_altitude: height + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + variables: + - name: stationPressure + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Initial Error Assignments for SFC Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/pressure + is_in: [181] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/pressure + is_in: [187] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [85000, 80000, 75000, 70000, 65000, 60000, 55000] + errors: [120, 140, 140, 140, 140, 140, 1.0e+11] + + # Initial Error Assignments for SFCSHIP Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/pressure + is_in: [180] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [60000, 55000] + errors: [130, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/pressure + is_in: [183] + action: + name: assign error + error parameter: 1.0e+11 + + # Initial Error Assignments for Radiosonde + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/pressure + is_in: [120] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: InputObsError/stationPressure + type: float + source variable: ObsErrorData/stationPressure + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/stationPressure + type: int + source variable: QualityMarker/stationPressure + + # Create PreUseFlag group variable (usage in GSI read_prepbufr) + # Initialize + - filter: Variable Assignment + assignments: + - name: PreUseFlag/stationPressure + type: int + source variable: PreQC/stationPressure + + - filter: Variable Assignment + where: + - variable: + name: PreUseFlag/stationPressure + is_in: 1-15 + assignments: + - name: PreUseFlag/stationPressure + value: 0 + # Re-assignment + - filter: Variable Assignment + where: + - variable: + name: ObsType/pressure + is_in: 183 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: ObsValue/stationPressure + is_defined: + - variable: + name: ObsValue/stationPressure + maxvalue: 50000.00 + where operator: and + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 9, 12, 15 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 4-15 + assignments: + - name: PreUseFlag/stationPressure + value: 101 + + ## Observation range sanity check + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 37499.0 + # maxvalue: 106999.0 + # action: + # name: reject + ## Reject all ObsType 183 + #- filter: RejectList + # where: + # - variable: + # name: ObsType/pressure + # is_in: 183 + ## Reject surface pressure below 500 hPa + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 50000.00 + # action: + # name: reject + #- filter: RejectList + # where: + # - variable: + # name: PreQC/stationPressure + # is_in: 4-15 + # Inflate obs error based on obs type + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3, 7 + action: + name: inflate error + inflation factor: 1.2 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Calculate obs error inflation factors for duplicated observations at the same location + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorDuplicateCheck/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorDuplicateCheck + options: + use_air_pressure: false + variable: stationPressure + + # Reduce effective observation error based on obs type and subtype + # In this case: reduce effective obs error for buoy + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: + name: ObsType/pressure + is_in: 180 + - variable: + name: ObsSubType/stationPressure + is_in: 0 + action: + name: inflate error + inflation factor: 0.7 + + # Calculate obs error inflation factors for large discrepancies between model and observations + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSfcPressure/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorSfcPressure + options: + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + station_altitude: height + + # Inflate surface pressure observation based on discrepancies between + # model and observations due to terrian + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSfcPressure/stationPressure + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/Innovation + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/stationPressure + - name: HofX/stationPressure + coefs: [1, -1] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 5.0 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_not_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + action: + name: reject + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 3.5 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + action: + name: reject + + # Inflate obs error based on duplicate check + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorDuplicateCheck/stationPressure + + # Reject data based on PreUseFlag (usage in GSI) + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreUseFlag/stationPressure + is_not_in: 0, 1 + action: + name: reject + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/prepbufr_sfcshp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/prepbufr_sfcshp.yaml.j2 new file mode 100644 index 000000000..d11297ebf --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/prepbufr_sfcshp.yaml.j2 @@ -0,0 +1,369 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure] + + # Observation Operator + # -------------------- + obs operator: + name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + station_altitude: height + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + variables: + - name: stationPressure + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Initial Error Assignments for SFC Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [181] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [187] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [85000, 80000, 75000, 70000, 65000, 60000, 55000] + errors: [120, 140, 140, 140, 140, 140, 1.0e+11] + + # Initial Error Assignments for SFCSHIP Observations + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [180] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [60000, 55000] + errors: [130, 1.0e+11] + + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [183] + action: + name: assign error + error parameter: 1.0e+11 + + # Initial Error Assignments for Radiosonde + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: ObsType/stationPressure + is_in: [120] + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + round_to_the_nearest_integer: true + xvar: + name: ObsValue/stationPressure + xvals: [80000, 75000, 70000, 65000, 60000, 55000] + errors: [110, 120, 120, 120, 120, 1.0e+11] + + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: InputObsError/stationPressure + type: float + source variable: ObsErrorData/stationPressure + + # Set observation quality-realted variables + # Create PreQC group variable (pqm in GSI read_prepbufr) + - filter: Variable Assignment + assignments: + - name: PreQC/stationPressure + type: int + source variable: QualityMarker/stationPressure + + # Create PreUseFlag group variable (usage in GSI read_prepbufr) + # Initialize + - filter: Variable Assignment + assignments: + - name: PreUseFlag/stationPressure + type: int + source variable: PreQC/stationPressure + + - filter: Variable Assignment + where: + - variable: + name: PreUseFlag/stationPressure + is_in: 1-15 + assignments: + - name: PreUseFlag/stationPressure + value: 0 + # Re-assignment + - filter: Variable Assignment + where: + - variable: + name: ObsType/stationPressure + is_in: 183 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: ObsValue/stationPressure + is_defined: + - variable: + name: ObsValue/stationPressure + maxvalue: 50000.00 + where operator: and + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 9, 12, 15 + assignments: + - name: PreUseFlag/stationPressure + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: PreQC/stationPressure + is_in: 4-15 + assignments: + - name: PreUseFlag/stationPressure + value: 101 + + ## Observation range sanity check + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 37499.0 + # maxvalue: 106999.0 + # action: + # name: reject + ## Reject all ObsType 183 + #- filter: RejectList + # where: + # - variable: + # name: ObsType/stationPressure + # is_in: 183 + ## Reject surface pressure below 500 hPa + #- filter: Bounds Check + # filter variables: + # - name: stationPressure + # minvalue: 50000.00 + # action: + # name: reject + #- filter: RejectList + # where: + # - variable: + # name: PreQC/stationPressure + # is_in: 4-15 + # Inflate obs error based on obs type + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3, 7 + action: + name: inflate error + inflation factor: 1.2 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Calculate obs error inflation factors for duplicated observations at the same location + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorDuplicateCheck/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorDuplicateCheck + options: + use_air_pressure: false + variable: stationPressure + + # Reduce effective observation error based on obs type and subtype + # In this case: reduce effective obs error for buoy + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: + name: ObsType/stationPressure + is_in: 180 + - variable: + name: MetaData/observationSubTypeNum + is_in: 0 + action: + name: inflate error + inflation factor: 0.7 + + # Calculate obs error inflation factors for large discrepancies between model and observations + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSfcPressure/stationPressure + type: float + function: + name: ObsFunction/ObsErrorFactorSfcPressure + options: + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + station_altitude: height + + # Inflate surface pressure observation based on discrepancies between + # model and observations due to terrian + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSfcPressure/stationPressure + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/Innovation + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/stationPressure + - name: HofX/stationPressure + coefs: [1, -1] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 5.0 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_not_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure1 + action: + name: reject + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + type: float + function: + name: ObsFunction/ObsErrorBoundConventional + options: + obsvar: stationPressure + obserr_bound_min: 100 + obserr_bound_max: 300 + obserr_bound_factor: 3.5 + + - filter: Background Check + filter variables: + - name: stationPressure + where: + - variable: PreQC/stationPressure + is_in: 3 + function absolute threshold: + - name: DerivedMetaData/ObsErrorBoundSfcPressure2 + action: + name: reject + + # Inflate obs error based on duplicate check + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorDuplicateCheck/stationPressure + + # Reject data based on PreUseFlag (usage in GSI) + - filter: Perform Action + filter variables: + - name: stationPressure + where: + - variable: PreUseFlag/stationPressure + is_not_in: 0, 1 + action: + name: reject + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_abi_g16.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_abi_g16.yaml.j2 new file mode 100644 index 000000000..0c721f322 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_abi_g16.yaml.j2 @@ -0,0 +1,475 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id abi_g16 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs prior filters: + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_err [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceFlag + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 4 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 0 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 1 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 2 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 3 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceParam + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 0 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 30 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 15 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 20 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 15 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/thinningCriteria + type: int + function: + name: IntObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/surfaceParam + coefs: [1] + + obs post filters: + # Satellite Zenith Angle Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: MetaData/sensorZenithAngle + maxvalue: 65. + action: + name: reject + +# from read_abi: Reject when cloud fraction is more than 30 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7-16 + where: + - variable: + name: MetaData/cloudAmount + channels: 8 + maxvalue: 30. + +# from read_abi: WV Channels 8-10 scene consistency check SDTB>1.3 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7-16 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 8-10 + maxvalue: 1.3 + max_exclusive: true + +# Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: maximum + time_mesh: 'PT06H' + time_min: '2021-07-31T21:00:00Z' + time_max: '2021-08-01T03:00:00Z' + priority_variable: DerivedMetaData/thinningCriteria + action: + name: reject + +# Surface type check + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 7, 11-16 + where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/land_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/ice_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/surface_snow_area_fraction + maxvalue: 0.99 + max_exclusive: true + +# BT range check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 0.0 + maxvalue: 1000.0 + action: + name: reject + +# Model top transmittance check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + +# Cloud detection + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [-2, -2, -2, -2, -2, -2, -2, -2, -2, -2] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + error parameter vector: *{{observation_from_jcb}}_err + maxvalue: 1.0e-12 + action: + name: reject + +# Scene Consistency Check based on ch13 (10.8 micron) + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7, 10-16 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 13 + maxvalue: 0.5 + max_exclusive: true + + +# Scene Consistency Channels 8-10 Based on ch 8 SDTB + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + maxvalue: 0.5 + minvalue: 0.4 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.1489 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + maxvalue: 0.6 +# max_exclusive: true + minvalue: 0.5 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.2923 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + maxvalue: 0.7 +# max_exclusive: true + minvalue: 0.6 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.4967 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + minvalue: 0.7 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.5199 + +# Near SST Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + maxvalue: 1.0e-12 + action: + name: reject + +# Surface Jacobian + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + +# Channels 7, 10-16 Cloud fraction >2 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7, 10-16 + where: + - variable: + name: MetaData/cloudAmount + maxvalue: 2 + +# Variable assignment, OmF non bias corrected + - filter: Variable Assignment + assignments: + - name: OmFNBC@DerivedMetaData + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: brightnessTemperature@ObsValue + channels: 13 + - name: brightnessTemperature@HofX + channels: 13 + - name: brightnessTemperature@ObsBiasData + channels: 13 + - name: brightnessTemperature@ObsValue + channels: 14 + - name: brightnessTemperature@HofX + channels: 14 + - name: brightnessTemperature@ObsBiasData + channels: 14 + coefs: [1, -1, 1, -1, 1, -1] + +# Channels 7, 10-16, OmFNBC < -0.75 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7, 10-16 + where: + - variable: + name: OmFNBC@DerivedMetaData + minvalue: -0.75 + max_exclusive: true + +# Final gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [0.0, 0.0, 0.0, 0.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_err + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 + diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_abi_g17.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_abi_g17.yaml.j2 new file mode 100644 index 000000000..fc972cb54 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_abi_g17.yaml.j2 @@ -0,0 +1,475 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id abi_g17 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs prior filters: + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_err [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceFlag + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 4 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 0 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 1 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 2 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 3 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceParam + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 0 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 30 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 15 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 20 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 15 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/thinningCriteria + type: int + function: + name: IntObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/surfaceParam + coefs: [1] + + obs post filters: + # Satellite Zenith Angle Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: MetaData/sensorZenithAngle + maxvalue: 65. + action: + name: reject + +# from read_abi: Reject when cloud fraction is more than 30 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7-16 + where: + - variable: + name: MetaData/cloudAmount + channels: 8 + maxvalue: 30. + +# from read_abi: WV Channels 8-10 scene consistency check SDTB>1.3 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7-16 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 8-10 + maxvalue: 1.3 + max_exclusive: true + +# Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: maximum + time_mesh: 'PT06H' + time_min: '2021-07-31T21:00:00Z' + time_max: '2021-08-01T03:00:00Z' + priority_variable: DerivedMetaData/thinningCriteria + action: + name: reject + +# Surface type check + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 7, 11-16 + where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/land_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/ice_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/surface_snow_area_fraction + maxvalue: 0.99 + max_exclusive: true + +# BT range check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 0.0 + maxvalue: 1000.0 + action: + name: reject + +# Model top transmittance check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + +# Cloud detection + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [-2, -2, -2, -2, -2, -2, -2, -2, -2, -2] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + error parameter vector: *{{observation_from_jcb}}_err + maxvalue: 1.0e-12 + action: + name: reject + +# Scene Consistency Check based on ch13 (10.8 micron) + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7, 10-16 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 13 + maxvalue: 0.5 + max_exclusive: true + + +# Scene Consistency Channels 8-10 Based on ch 8 SDTB + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + maxvalue: 0.5 + minvalue: 0.4 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.1489 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + maxvalue: 0.6 +# max_exclusive: true + minvalue: 0.5 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.2923 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + maxvalue: 0.7 +# max_exclusive: true + minvalue: 0.6 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.4967 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 8-10 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_8 + minvalue: 0.7 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.5199 + +# Near SST Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + maxvalue: 1.0e-12 + action: + name: reject + +# Surface Jacobian + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + +# Channels 7, 10-16 Cloud fraction >2 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7, 10-16 + where: + - variable: + name: MetaData/cloudAmount + maxvalue: 2 + +# Variable assignment, OmF non bias corrected + - filter: Variable Assignment + assignments: + - name: OmFNBC@DerivedMetaData + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: brightnessTemperature@ObsValue + channels: 13 + - name: brightnessTemperature@HofX + channels: 13 + - name: brightnessTemperature@ObsBiasData + channels: 13 + - name: brightnessTemperature@ObsValue + channels: 14 + - name: brightnessTemperature@HofX + channels: 14 + - name: brightnessTemperature@ObsBiasData + channels: 14 + coefs: [1, -1, 1, -1, 1, -1] + +# Channels 7, 10-16, OmFNBC < -0.75 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 7, 10-16 + where: + - variable: + name: OmFNBC@DerivedMetaData + minvalue: -0.75 + max_exclusive: true + +# Final gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [0.0, 0.0, 0.0, 0.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_err + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 + diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_amsr2_gcom-w1.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_amsr2_gcom-w1.yaml.j2 new file mode 100644 index 000000000..6618ea029 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_amsr2_gcom-w1.yaml.j2 @@ -0,0 +1,399 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: &{{observation_from_jcb}}_clouds [Water, Ice, Rain, Snow, Graupel] +# Cloud_Fraction: 1.0 +# ---methods for cloud fraction and radii in fov: thompson, or none + method for cloud fraction within fov: thompson + method for hydrometeor effective radii within fov: thompson + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id amsr2_gcom-w1 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 100 + use_reduced_horizontal_grid: true + distance_norm: geodesic + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # ------------------------ + obs prior filters: + # Zero Atmospheric clouds in CRTM where water_area_fraction < 0.99 + - filter: Variable Assignment + assignments: + - name: MetaData/zeroCloudInCRTM + type: int + function: + name: ObsFunction/Conditional + options: + # firstmatchingcase: false + defaultvalue: 0 # Will not zero clouds by default + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + value: 1 # Will zero clouds by default + + obs post filters: + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.0 + maxvalue: 340.0 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + - variable: + name: GeoVaLs/skin_temperature_at_surface_where_sea + minvalue: 275 + - variable: + name: GeoVaLs/wind_speed_at_surface + maxvalue: 12 + - variable: + name: MetaData/latitude + minvalue: -60.0 + maxvalue: 60.0 + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/TotalColumnVaporGuess + minvalue: 10.0 + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/SunGlintAngle + minvalue: 20.0 + + # Save CLW retrievals from ObsValue + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/clw_obs + type: float + function: + name: ObsFunction/CLWRetMW + options: + clwret_ch18v: 7 + clwret_ch18h: 8 + clwret_ch36v: 11 + clwret_ch36h: 12 + sys_bias: [0.4800, 3.0737, 0.7433, 3.6430, + 3.5304, 4.4270, 5.1448, 5.0785, + 4.9763, 9.3215, 2.5789, 5.5274, + 0.6641, 1.3674] + clwret_types: [ObsValue] + # Save CLW retrievals from HofX + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/clw_guess_retrieval + type: float + function: + name: ObsFunction/CLWRetMW + options: + clwret_ch18v: 7 + clwret_ch18h: 8 + clwret_ch36v: 11 + clwret_ch36h: 12 + sys_bias: [0.4800, 3.0737, 0.7433, 3.6430, + 3.5304, 4.4270, 5.1448, 5.0785, + 4.9763, 9.3215, 2.5789, 5.5274, + 0.6641, 1.3674] + clwret_types: [HofX] + # Ckeck CLW retrievals from observations + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/clw_obs + maxvalue: 1.0 + # Ckeck CLW retrievals from HofX + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/clw_guess_retrieval + maxvalue: 1.0 + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + value: + name: DerivedMetaData/clw_obs + reference: + name: DerivedMetaData/clw_guess_retrieval + minvalue: -0.5 + maxvalue: 0.5 + # Combined (clw_obs + clw_guess_retrieval)/2.0 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/CLWRetSymmetricMW + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/clw_obs + - name: DerivedMetaData/clw_guess_retrieval + coefs: [0.5, 0.5] + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelRamp + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: DerivedMetaData/CLWRetSymmetricMW + x0: &{{observation_from_jcb}}_x0 [{{ get_satellite_variable(observation_from_jcb, "x0") }}] + x1: &{{observation_from_jcb}}_x1 [{{ get_satellite_variable(observation_from_jcb, "x1") }}] + err0: &{{observation_from_jcb}}_err0 [{{ get_satellite_variable(observation_from_jcb, "error") }}] + err1: &{{observation_from_jcb}}_err1 [{{ get_satellite_variable(observation_from_jcb, "error_cld") }}] + + ## Prepare variables used by cold-air-outbreak checks in all-sky. + # Combined ColumnLiquidCloud + ColumnIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidandIceCloud + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: GeoVaLs/mass_content_of_cloud_ice_in_atmosphere_column + coefs: [1, 1] + # replace zero by 9.99e-7 in DerivedMetaData/ColumnLiquidandIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidandIceCloud + type: float + value: 9.99e-07 + where: + - variable: + name: DerivedMetaData/ColumnLiquidandIceCloud + maxvalue: 9.99e-07 + + # ratio of liquid /(Liquid+Ice) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + function: + name: ObsFunction/ElementMultiply + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: DerivedMetaData/ColumnLiquidandIceCloud + exponents: [1,-1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + value: 0.0 + where: + - variable: + name: DerivedMetaData/ColumnLiquidandIceCloud + maxvalue: 1.0e-06 + + # TotalColumnVaporGuess + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/TotalColumnVaporGuess + type: float + function: + name: ObsFunction/TotalColumnVaporGuess + + # potentialTemperature at surface + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureSurface + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: true + # potentialTemperature near 700 hPa + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: false + pressure to evaluate potential temperature: 70000.0 + # stability = Difference between PotentialTemperatur values + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureDiff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + - name: DerivedMetaData/PotentialTemperatureSurface + coefs: [1, -1] + # cold-air-outbreak (cao) check for all-sky DA with Rain, Snow, or Graupel + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: ObsFunction/TotalColumnVaporGuess + maxvalue: 8.0 + - variable: + name: DerivedMetaData/ColumnRatioLiquidCloud + maxvalue: 0.5 + - variable: + name: DerivedMetaData/PotentialTemperatureDiff + maxvalue: 12.0 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # Background check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: 1-6 + threshold: 3.0 + action: + name: reject + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: 7-14 + threshold: 2.0 + action: + name: reject + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: 7-10 + absolute threshold: 30 + action: + name: reject + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: 11-14 + absolute threshold: 50 + action: + name: reject + # Useflag check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + # use passive_bc: true + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_amsua_n19.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_amsua_n19.yaml.j2 new file mode 100644 index 000000000..541ee0880 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_amsua_n19.yaml.j2 @@ -0,0 +1,500 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: &{{observation_from_jcb}}_clouds [Water, Ice, Rain, Snow, Graupel] +# Cloud_Fraction: 1.0 +# ---methods for cloud fraction and radii in fov: thompson, or none + method for cloud fraction within fov: thompson + method for hydrometeor effective radii within fov: thompson + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id amsua_n19 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + # Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 1-15 + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 4-27 + action: + name: reduce obs space + + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # ------------------------ + obs prior filters: + # Zero Atmospheric clouds in CRTM where water_area_fraction < 0.99 + - filter: Variable Assignment + assignments: + - name: MetaData/zeroCloudInCRTM + type: int + function: + name: ObsFunction/Conditional + options: +# firstmatchingcase: false + defaultvalue: 0 # Will not zero clouds by default + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + value: 1 # Will zero clouds by default + + obs post filters: + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelRamp + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: ObsFunction/CLWRetSymmetricMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue, HofX] + x0: &{{observation_from_jcb}}_x0 [{{ get_satellite_variable(observation_from_jcb, "x0") }}] + x1: &{{observation_from_jcb}}_x1 [{{ get_satellite_variable(observation_from_jcb, "x1") }}] + err0: &{{observation_from_jcb}}_err0 [{{ get_satellite_variable(observation_from_jcb, "error") }}] + err1: &{{observation_from_jcb}}_err1 [{{ get_satellite_variable(observation_from_jcb, "error_cld") }}] + # CLW Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-6, 15 + test variables: + - name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + maxvalue: 999.0 + action: + name: reject + # CLW Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-6, 15 + test variables: + - name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + maxvalue: 999.0 + action: + name: reject + # Hydrometeor Check (cloud/precipitation affected chanels) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/HydrometeorCheckAMSUA + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + Clouds: *{{observation_from_jcb}}_clouds + obserr_clearsky: *{{observation_from_jcb}}_err0 + clwret_function: + name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + obserr_function: + name: ObsFunction/ObsErrorModelRamp + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: ObsFunction/CLWRetSymmetricMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue, HofX] + x0: *{{observation_from_jcb}}_x0 + x1: *{{observation_from_jcb}}_x1 + err0: *{{observation_from_jcb}}_err0 + err1: *{{observation_from_jcb}}_err1 + maxvalue: 0.0 + action: + name: reject + # Topography check + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + # Transmittnace Top Check + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + # Surface Jacobian check + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.020, 0.015, 0.020, 0.200] + obserr_dtempf: [0.500, 2.000, 1.000, 2.000, 4.500] + # Situation dependent Check + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSituDependMW + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + clwbkg_function: + name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + bias_application: HofX + scatobs_function: + name: ObsFunction/SCATRetMW + options: + scatret_ch238: 1 + scatret_ch314: 2 + scatret_ch890: 15 + scatret_types: [ObsValue] + bias_application: HofX + clwmatchidx_function: + name: ObsFunction/CLWMatchIndexMW + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + clwbkg_function: + name: ObsFunction/CLWRetMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + bias_application: HofX + clwret_clearsky: *{{observation_from_jcb}}_x0 + obserr_function: + name: ObsFunction/ObsErrorModelRamp + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: ObsFunction/CLWRetSymmetricMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue, HofX] + x0: *{{observation_from_jcb}}_x0 + x1: *{{observation_from_jcb}}_x1 + err0: *{{observation_from_jcb}}_err0 + err1: *{{observation_from_jcb}}_err1 + obserr_clearsky: *{{observation_from_jcb}}_err0 + # Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundMW + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.25, 0.04, 3.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_topo: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + obserr_function: + name: ObsFunction/ObsErrorModelRamp + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: ObsFunction/CLWRetSymmetricMW + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue, HofX] + bias_application: HofX + x0: *{{observation_from_jcb}}_x0 + x1: *{{observation_from_jcb}}_x1 + err0: *{{observation_from_jcb}}_err0 + err1: *{{observation_from_jcb}}_err1 + threshold: 3 + threshold_precip: 2.5 + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + action: + name: reject + # Inter-channel check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/InterChannelConsistencyCheck + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + maxvalue: 1.0e-12 + action: + name: reject + # Useflag check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject +# Combined ColumnLiquidCloud + ColumnIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: GeoVaLs/mass_content_of_cloud_ice_in_atmosphere_column + coefs: [1, 1] +# replace zero by 9.99e-7 in DerivedMetaData/ColumnLiquidIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + value: 9.99e-07 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 9.99e-07 + +# ratio of liquid /(Liquid+Ice) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + function: + name: ObsFunction/ElementMultiply + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: DerivedMetaData/ColumnLiquidIceCloud + exponents: [1,-1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + value: 0.0 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 1.0e-06 +# TotalColumnVaporGuess + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/TotalColumnVaporGuess + type: float + function: + name: ObsFunction/TotalColumnVaporGuess +# potentialTemperature at surface + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureSurface + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: true +# potentialTemperature near 700 hPa + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: false + pressure to evaluate potential temperature: 70000.0 +# stability = Difference between PotentialTemperatur values + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureDiff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + - name: DerivedMetaData/PotentialTemperatureSurface + coefs: [1, -1] +# cold-air-outbreak (cao) check for all-sky DA with Rain, Snow, or Graupel + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: 1-6, 15 + where: + - variable: + name: ObsFunction/TotalColumnVaporGuess + maxvalue: 8.0 + - variable: + name: DerivedMetaData/ColumnRatioLiquidCloud + maxvalue: 0.5 + - variable: + name: DerivedMetaData/PotentialTemperatureDiff + maxvalue: 12.0 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_atms_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_atms_n20.yaml.j2 new file mode 100644 index 000000000..bebdb2757 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_atms_n20.yaml.j2 @@ -0,0 +1,627 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: &{{observation_from_jcb}}_clouds [Water, Ice, Rain, Snow, Graupel] +# Cloud_Fraction: 1.0 +# ---methods for cloud fraction and radii in fov: thompson, or none + method for cloud fraction within fov: thompson + method for hydrometeor effective radii within fov: thompson + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id atms_n20 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + do fov average: true + fov sample points per semimajor axis: 4 + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # ------------------------ + obs pre filters: + # Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 1-22 + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 7-90 + action: + name: reduce obs space + + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # ------------------------ + obs prior filters: + # Zero Atmospheric clouds in CRTM where water_area_fraction < 0.99 + - filter: Variable Assignment + assignments: + - name: MetaData/zeroCloudInCRTM + type: int + function: + name: ObsFunction/Conditional + options: +# firstmatchingcase: false + defaultvalue: 0 # Will not zero clouds by default + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + value: 1 # Will zero clouds by default + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 0-B: Calculate derived variables + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromObs@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromBkg@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + + # Calculate symmetric retrieved CLW + - filter: Variable Assignment + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + value: 1000.0 + + - filter: Variable Assignment + where: + - variable: + name: CLWRetFromObs@DerivedMetaData + minvalue: 0. + maxvalue: 999. + - variable: + name: CLWRetFromBkg@DerivedMetaData + minvalue: 0. + maxvalue: 999. + where operator: and + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + function: + name: Arithmetic@ObsFunction + options: + variables: + - name: CLWRetFromObs@DerivedMetaData + - name: CLWRetFromBkg@DerivedMetaData + total coefficient: 0.5 + + # Calculate scattering index from observation + - filter: Variable Assignment + assignments: + - name: SIRetFromObs@DerivedMetaData + type: float + function: + name: SCATRetMW@ObsFunction + options: + scatret_ch238: 1 + scatret_ch314: 2 + scatret_ch890: 16 + scatret_types: [ObsValue] + + # Calculate CLW obs/bkg match index + - filter: Variable Assignment + assignments: + - name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: CLWMatchIndexMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwret_clearsky: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, + 0.030, 0.030, 0.050, 0.100] + + # Calculate symmetric observation error + - filter: Variable Assignment + assignments: + - name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorModelRamp@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: CLWRetSymmetric@DerivedMetaData + x0: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, 0.030, 0.030, + 0.050, 0.100] + x1: [0.350, 0.380, 0.400, 0.450, 0.500, 1.000, 1.000, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.350, 0.500, 0.500, 0.500, 0.500, + 0.500, 0.500] + err0: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, 0.400, 0.400, + 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, 3.000, 3.000, + 3.000, 3.000] + err1: [20.000, 25.000, 12.000, 7.000, 3.500, 3.000, 0.800, 0.400, 0.400, + 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 19.000, 30.000, 25.000, 16.500, + 12.000, 9.000, 6.500] + + # Calculate Innovation@DerivedMetaData + - filter: Variable Assignment + assignments: + - name: Innovation@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/Arithmetic + channels: *{{observation_from_jcb}}_simulated_channels + options: + variables: + - name: brightnessTemperature@ObsValue + channels: *{{observation_from_jcb}}_simulated_channels + - name: brightnessTemperature@HofX + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [1, -1] + + # Step 0-C: Assign Initial All-Sky Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 1A: CLW Retrieval Check (observation_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromObs@DerivedMetaData + maxvalue: 999.0 + action: + name: reject + + # Step 1B: CLW Retrieval Check (background_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromBkg@DerivedMetaData + maxvalue: 999.0 + action: + name: reject + + # Step 2: Window Channel Sanity Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16, 17-22 + test variables: + - name: Innovation@DerivedMetaData + channels: 1, 2, 5-7, 16 + maxvalue: 200.0 + minvalue: -200.0 + flag all filter variables if any test variable is out of bounds: true + action: + name: reject + + # Step 3: Hydrometeor Check (cloud/precipitation affected chanels) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: HydrometeorCheckATMS@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + clwret_function: + name: CLWRetFromObs@DerivedMetaData + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + Clouds: *{{observation_from_jcb}}_clouds + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.0 + action: + name: reject + + # Step 4: Observation Error Inflation based on Topography Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTopoRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 5: Obs Error Inflation based on TOA Transmittancec Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTransmitTopRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 6: Observation Error Inflation based on Surface Jacobian Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSurfJacobianRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.020, 0.015, 0.020, 0.200] + obserr_dtempf: [0.500, 2.000, 1.000, 2.000, 4.500] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 7: Situation Dependent Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSituDependMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + scatobs_function: + name: SIRetFromObs@DerivedMetaData + clwmatchidx_function: + name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Gross check + # Remove data if abs(Obs-HofX) > absolute threshold + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorLat@DerivedMetaData + type: float + function: + name: ObsErrorFactorLatRad@ObsFunction + options: + latitude_parameters: [25.0, 0.25, 0.04, 3.0] + + - filter: Variable Assignment + assignments: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorBoundMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsErrorFactorLat@DerivedMetaData + obserr_bound_transmittop: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_topo: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + threshold: 3 + threshold_precip: 2.5 + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: reject + + # Step 9: Inter-Channel Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: InterChannelConsistencyCheck@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use passive_bc: true + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 10: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + minvalue: 1.0e-12 + action: + name: reject + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: GeoVaLs/mass_content_of_cloud_ice_in_atmosphere_column + coefs: [1, 1] +# replace zero by 9.99e-7 in DerivedMetaData/ColumnLiquidIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + value: 9.99e-07 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 9.99e-07 + +# ratio of liquid /(Liquid+Ice) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + function: + name: ObsFunction/ElementMultiply + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: DerivedMetaData/ColumnLiquidIceCloud + exponents: [1,-1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + value: 0.0 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 1.0e-06 +# TotalColumnVaporGuess + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/TotalColumnVaporGuess + type: float + function: + name: ObsFunction/TotalColumnVaporGuess +# potentialTemperature at surface + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureSurface + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: true +# potentialTemperature near 700 hPa + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: false + pressure to evaluate potential temperature: 70000.0 +# stability = Difference between PotentialTemperatur values + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureDiff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + - name: DerivedMetaData/PotentialTemperatureSurface + coefs: [1, -1] +# cold-air-outbreak (cao) check for all-sky DA with Rain, Snow, or Graupel + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + where: + - variable: + name: ObsFunction/TotalColumnVaporGuess + maxvalue: 8.0 + - variable: + name: DerivedMetaData/ColumnRatioLiquidCloud + maxvalue: 0.5 + - variable: + name: DerivedMetaData/PotentialTemperatureDiff + maxvalue: 12.0 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_atms_n21.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_atms_n21.yaml.j2 new file mode 100644 index 000000000..b5c0860d4 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_atms_n21.yaml.j2 @@ -0,0 +1,625 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: &{{observation_from_jcb}}_clouds [Water, Ice, Rain, Snow, Graupel] +# Cloud_Fraction: 1.0 +# ---methods for cloud fraction and radii in fov: thompson, or none + method for cloud fraction within fov: thompson + method for hydrometeor effective radii within fov: thompson + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id atms_n21 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # ------------------------ + obs pre filters: + # Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 1-22 + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 7-90 + action: + name: reduce obs space + + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # ------------------------ + obs prior filters: + # Zero Atmospheric clouds in CRTM where water_area_fraction < 0.99 + - filter: Variable Assignment + assignments: + - name: MetaData/zeroCloudInCRTM + type: int + function: + name: ObsFunction/Conditional + options: +# firstmatchingcase: false + defaultvalue: 0 # Will not zero clouds by default + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + value: 1 # Will zero clouds by default + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 0-B: Calculate derived variables + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromObs@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromBkg@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + + # Calculate symmetric retrieved CLW + - filter: Variable Assignment + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + value: 1000.0 + + - filter: Variable Assignment + where: + - variable: + name: CLWRetFromObs@DerivedMetaData + minvalue: 0. + maxvalue: 999. + - variable: + name: CLWRetFromBkg@DerivedMetaData + minvalue: 0. + maxvalue: 999. + where operator: and + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + function: + name: Arithmetic@ObsFunction + options: + variables: + - name: CLWRetFromObs@DerivedMetaData + - name: CLWRetFromBkg@DerivedMetaData + total coefficient: 0.5 + + # Calculate scattering index from observation + - filter: Variable Assignment + assignments: + - name: SIRetFromObs@DerivedMetaData + type: float + function: + name: SCATRetMW@ObsFunction + options: + scatret_ch238: 1 + scatret_ch314: 2 + scatret_ch890: 16 + scatret_types: [ObsValue] + + # Calculate CLW obs/bkg match index + - filter: Variable Assignment + assignments: + - name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: CLWMatchIndexMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwret_clearsky: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, + 0.030, 0.030, 0.050, 0.100] + + # Calculate symmetric observation error + - filter: Variable Assignment + assignments: + - name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorModelRamp@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: CLWRetSymmetric@DerivedMetaData + x0: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, 0.030, 0.030, + 0.050, 0.100] + x1: [0.350, 0.380, 0.400, 0.450, 0.500, 1.000, 1.000, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.350, 0.500, 0.500, 0.500, 0.500, + 0.500, 0.500] + err0: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, 0.400, 0.400, + 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, 3.000, 3.000, + 3.000, 3.000] + err1: [20.000, 25.000, 12.000, 7.000, 3.500, 3.000, 0.800, 0.400, 0.400, + 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 19.000, 30.000, 25.000, 16.500, + 12.000, 9.000, 6.500] + + # Calculate Innovation@DerivedMetaData + - filter: Variable Assignment + assignments: + - name: Innovation@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/Arithmetic + channels: *{{observation_from_jcb}}_simulated_channels + options: + variables: + - name: brightnessTemperature@ObsValue + channels: *{{observation_from_jcb}}_simulated_channels + - name: brightnessTemperature@HofX + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [1, -1] + + # Step 0-C: Assign Initial All-Sky Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 1A: CLW Retrieval Check (observation_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromObs@DerivedMetaData + maxvalue: 999.0 + action: + name: reject + + # Step 1B: CLW Retrieval Check (background_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromBkg@DerivedMetaData + maxvalue: 999.0 + action: + name: reject + + # Step 2: Window Channel Sanity Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16, 17-22 + test variables: + - name: Innovation@DerivedMetaData + channels: 1, 2, 5-7, 16 + maxvalue: 200.0 + minvalue: -200.0 + flag all filter variables if any test variable is out of bounds: true + action: + name: reject + + # Step 3: Hydrometeor Check (cloud/precipitation affected chanels) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: HydrometeorCheckATMS@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + clwret_function: + name: CLWRetFromObs@DerivedMetaData + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + Clouds: *{{observation_from_jcb}}_clouds + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.0 + action: + name: reject + + # Step 4: Observation Error Inflation based on Topography Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTopoRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 5: Obs Error Inflation based on TOA Transmittancec Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTransmitTopRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 6: Observation Error Inflation based on Surface Jacobian Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSurfJacobianRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.020, 0.015, 0.020, 0.200] + obserr_dtempf: [0.500, 2.000, 1.000, 2.000, 4.500] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 7: Situation Dependent Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSituDependMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + scatobs_function: + name: SIRetFromObs@DerivedMetaData + clwmatchidx_function: + name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Gross check + # Remove data if abs(Obs-HofX) > absolute threshold + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorLat@DerivedMetaData + type: float + function: + name: ObsErrorFactorLatRad@ObsFunction + options: + latitude_parameters: [25.0, 0.25, 0.04, 3.0] + + - filter: Variable Assignment + assignments: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorBoundMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsErrorFactorLat@DerivedMetaData + obserr_bound_transmittop: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_topo: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + threshold: 3 + threshold_precip: 2.5 + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: reject + + # Step 9: Inter-Channel Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: InterChannelConsistencyCheck@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use passive_bc: true + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 10: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + minvalue: 1.0e-12 + action: + name: reject + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: GeoVaLs/mass_content_of_cloud_ice_in_atmosphere_column + coefs: [1, 1] +# replace zero by 9.99e-7 in DerivedMetaData/ColumnLiquidIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + value: 9.99e-07 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 9.99e-07 + +# ratio of liquid /(Liquid+Ice) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + function: + name: ObsFunction/ElementMultiply + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: DerivedMetaData/ColumnLiquidIceCloud + exponents: [1,-1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + value: 0.0 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 1.0e-06 +# TotalColumnVaporGuess + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/TotalColumnVaporGuess + type: float + function: + name: ObsFunction/TotalColumnVaporGuess +# potentialTemperature at surface + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureSurface + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: true +# potentialTemperature near 700 hPa + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: false + pressure to evaluate potential temperature: 70000.0 +# stability = Difference between PotentialTemperatur values + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureDiff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + - name: DerivedMetaData/PotentialTemperatureSurface + coefs: [1, -1] +# cold-air-outbreak (cao) check for all-sky DA with Rain, Snow, or Graupel + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + where: + - variable: + name: ObsFunction/TotalColumnVaporGuess + maxvalue: 8.0 + - variable: + name: DerivedMetaData/ColumnRatioLiquidCloud + maxvalue: 0.5 + - variable: + name: DerivedMetaData/PotentialTemperatureDiff + maxvalue: 12.0 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_atms_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_atms_npp.yaml.j2 new file mode 100644 index 000000000..ee80fbce1 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_atms_npp.yaml.j2 @@ -0,0 +1,625 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: &{{observation_from_jcb}}_clouds [Water, Ice, Rain, Snow, Graupel] +# Cloud_Fraction: 1.0 +# ---methods for cloud fraction and radii in fov: thompson, or none + method for cloud fraction within fov: thompson + method for hydrometeor effective radii within fov: thompson + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id atms_npp + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # ------------------------ + obs pre filters: + # Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 1-22 + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 7-90 + action: + name: reduce obs space + + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # ------------------------ + obs prior filters: + # Zero Atmospheric clouds in CRTM where water_area_fraction < 0.99 + - filter: Variable Assignment + assignments: + - name: MetaData/zeroCloudInCRTM + type: int + function: + name: ObsFunction/Conditional + options: +# firstmatchingcase: false + defaultvalue: 0 # Will not zero clouds by default + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + value: 1 # Will zero clouds by default + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 0-B: Calculate derived variables + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromObs@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [ObsValue] + + # Calculate CLW retrieved from observation + - filter: Variable Assignment + assignments: + - name: CLWRetFromBkg@DerivedMetaData + type: float + function: + name: CLWRetMW@ObsFunction + options: + clwret_ch238: 1 + clwret_ch314: 2 + clwret_types: [HofX] + + # Calculate symmetric retrieved CLW + - filter: Variable Assignment + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + value: 1000.0 + + - filter: Variable Assignment + where: + - variable: + name: CLWRetFromObs@DerivedMetaData + minvalue: 0. + maxvalue: 999. + - variable: + name: CLWRetFromBkg@DerivedMetaData + minvalue: 0. + maxvalue: 999. + where operator: and + assignments: + - name: CLWRetSymmetric@DerivedMetaData + type: float + function: + name: Arithmetic@ObsFunction + options: + variables: + - name: CLWRetFromObs@DerivedMetaData + - name: CLWRetFromBkg@DerivedMetaData + total coefficient: 0.5 + + # Calculate scattering index from observation + - filter: Variable Assignment + assignments: + - name: SIRetFromObs@DerivedMetaData + type: float + function: + name: SCATRetMW@ObsFunction + options: + scatret_ch238: 1 + scatret_ch314: 2 + scatret_ch890: 16 + scatret_types: [ObsValue] + + # Calculate CLW obs/bkg match index + - filter: Variable Assignment + assignments: + - name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: CLWMatchIndexMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwret_clearsky: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, + 0.030, 0.030, 0.050, 0.100] + + # Calculate symmetric observation error + - filter: Variable Assignment + assignments: + - name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorModelRamp@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: CLWRetSymmetric@DerivedMetaData + x0: [0.030, 0.030, 0.030, 0.020, 0.030, 0.080, 0.150, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.020, 0.030, 0.030, 0.030, 0.030, + 0.050, 0.100] + x1: [0.350, 0.380, 0.400, 0.450, 0.500, 1.000, 1.000, 0.000, 0.000, 0.000, + 0.000, 0.000, 0.000, 0.000, 0.000, 0.350, 0.500, 0.500, 0.500, 0.500, + 0.500, 0.500] + err0: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, 0.400, 0.400, + 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, 3.000, 3.000, + 3.000, 3.000] + err1: [20.000, 25.000, 12.000, 7.000, 3.500, 3.000, 0.800, 0.400, 0.400, + 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 19.000, 30.000, 25.000, 16.500, + 12.000, 9.000, 6.500] + + # Calculate Innovation@DerivedMetaData + - filter: Variable Assignment + assignments: + - name: Innovation@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/Arithmetic + channels: *{{observation_from_jcb}}_simulated_channels + options: + variables: + - name: brightnessTemperature@ObsValue + channels: *{{observation_from_jcb}}_simulated_channels + - name: brightnessTemperature@HofX + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [1, -1] + + # Step 0-C: Assign Initial All-Sky Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 1A: CLW Retrieval Check (observation_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromObs@DerivedMetaData + maxvalue: 999.0 + action: + name: reject + + # Step 1B: CLW Retrieval Check (background_based) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + test variables: + - name: CLWRetFromBkg@DerivedMetaData + maxvalue: 999.0 + action: + name: reject + + # Step 2: Window Channel Sanity Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-7, 16, 17-22 + test variables: + - name: Innovation@DerivedMetaData + channels: 1, 2, 5-7, 16 + maxvalue: 200.0 + minvalue: -200.0 + flag all filter variables if any test variable is out of bounds: true + action: + name: reject + + # Step 3: Hydrometeor Check (cloud/precipitation affected chanels) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: HydrometeorCheckATMS@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + clwret_function: + name: CLWRetFromObs@DerivedMetaData + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + Clouds: *{{observation_from_jcb}}_clouds + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/HydrometeorCheckATMS + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.0 + action: + name: reject + + # Step 4: Observation Error Inflation based on Topography Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTopoRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 5: Obs Error Inflation based on TOA Transmittancec Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorTransmitTopRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 6: Observation Error Inflation based on Surface Jacobian Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSurfJacobianRad@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.020, 0.015, 0.020, 0.200] + obserr_dtempf: [0.500, 2.000, 1.000, 2.000, 4.500] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSurfJacobian@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 7: Situation Dependent Check + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorFactorSituDependMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + clwbkg_function: + name: CLWRetFromBkg@DerivedMetaData + clwobs_function: + name: CLWRetFromObs@DerivedMetaData + scatobs_function: + name: SIRetFromObs@DerivedMetaData + clwmatchidx_function: + name: CLWMatchIndex@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_clearsky: [4.500, 4.500, 4.500, 2.500, 0.550, 0.300, 0.300, 0.400, + 0.400, 0.400, 0.450, 0.450, 0.550, 0.800, 4.000, 4.000, 4.000, 3.500, + 3.000, 3.000, 3.000, 3.000] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSituDepend@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Gross check + # Remove data if abs(Obs-HofX) > absolute threshold + - filter: Variable Assignment + assignments: + - name: ObsErrorFactorLat@DerivedMetaData + type: float + function: + name: ObsErrorFactorLatRad@ObsFunction + options: + latitude_parameters: [25.0, 0.25, 0.04, 3.0] + + - filter: Variable Assignment + assignments: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsErrorBoundMW@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsErrorFactorLat@DerivedMetaData + obserr_bound_transmittop: + name: ObsErrorFactorTransmitTop@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_topo: + name: ObsErrorFactorTopo@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + obserr_function: + name: InitialObsError@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + threshold: 3 + threshold_precip: 2.5 + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsErrorBound@DerivedMetaData + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: reject + + # Step 9: Inter-Channel Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: InterChannelConsistencyCheck@ObsFunction + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use passive_bc: true + sensor: *{{observation_from_jcb}}_sensor_id + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 10: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 1, 1, 1, 1, 1, 1, + 1] + minvalue: 1.0e-12 + action: + name: reject + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: GeoVaLs/mass_content_of_cloud_ice_in_atmosphere_column + coefs: [1, 1] +# replace zero by 9.99e-7 in DerivedMetaData/ColumnLiquidIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidIceCloud + type: float + value: 9.99e-07 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 9.99e-07 + +# ratio of liquid /(Liquid+Ice) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + function: + name: ObsFunction/ElementMultiply + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: DerivedMetaData/ColumnLiquidIceCloud + exponents: [1,-1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + value: 0.0 + where: + - variable: + name: DerivedMetaData/ColumnLiquidIceCloud + maxvalue: 1.0e-06 +# TotalColumnVaporGuess + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/TotalColumnVaporGuess + type: float + function: + name: ObsFunction/TotalColumnVaporGuess +# potentialTemperature at surface + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureSurface + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: true +# potentialTemperature near 700 hPa + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: false + pressure to evaluate potential temperature: 70000.0 +# stability = Difference between PotentialTemperatur values + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureDiff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + - name: DerivedMetaData/PotentialTemperatureSurface + coefs: [1, -1] +# cold-air-outbreak (cao) check for all-sky DA with Rain, Snow, or Graupel + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: 1-7, 16-22 + where: + - variable: + name: ObsFunction/TotalColumnVaporGuess + maxvalue: 8.0 + - variable: + name: DerivedMetaData/ColumnRatioLiquidCloud + maxvalue: 0.5 + - variable: + name: DerivedMetaData/PotentialTemperatureDiff + maxvalue: 12.0 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_n20.yaml.j2 new file mode 100644 index 000000000..d6698478c --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_n20.yaml.j2 @@ -0,0 +1,379 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 +{% if rad_to_tb | default(false) %} + observed variables: [spectralRadiance] + derived variables: [brightnessTemperature] +{% endif %} + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id cris-fsr_n20 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band1 19, 24, 26, 27, 28, 31, 32, 33, 37, 39, 42, 44, 47, 49, 50, + 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, + 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, + 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, + 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, + 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, + 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, + 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, + 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, + 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, + 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 208, + 211, 216, 224, 234, 236, 238, 239, 242, 246, 248, 255, 264, 266, 268, + 275, 279, 283, 285, 291, 295, 301, 305, 311, 332, 342, 389, 400, 402, + 404, 406, 410, 427, 439, 440, 441, 445, 449, 455, 458, 461, 464, 467, + 470, 473, 475, 482, 486, 487, 490, 493, 496, 499, 501, 503, 505, 511, + 513, 514, 518, 519, 520, 522, 529, 534, 563, 568, 575, 592, 594, 596, + 598, 600, 602, 604, 611, 614, 616, 618, 620, 622, 626, 631, 638, 646, + 648, 652, 659, 673, 675, 678, 684, 688, 694, 700, 707, 710, 713 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band1 + coefs: [62.5] + intercept: 64937.5 + use channel numbers: true + + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band2 714, 718, 720, 722, 725, 728, 735, 742, 748, 753, 762, 780, 784, 798, 849, + 860, 862, 866, 874, 882, 890, 898, 906, 907, 908, 914, 937, 972, 973, + 978, 980, 981, 988, 995, 998, 1000, 1003, 1008, 1009, 1010, 1014, 1017, + 1018, 1020, 1022, 1024, 1026, 1029, 1030, 1032, 1034, 1037, 1038, 1041, + 1042, 1044, 1046, 1049, 1050, 1053, 1054, 1058, 1060, 1062, 1064, 1066, + 1069, 1076, 1077, 1080, 1086, 1091, 1095, 1101, 1109, 1112, 1121, 1128, + 1133, 1163, 1172, 1187, 1189, 1205, 1211, 1219, 1231, 1245, 1271, 1289, + 1300, 1313, 1316, 1325, 1329, 1346, 1347, 1473, 1474, 1491, 1499, 1553, + 1570 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band2 + coefs: [62.5] + intercept: 76375 + use channel numbers: true + + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band3 1596, 1602, 1619, 1624, 1635, 1939, 1940, 1941, 1942, 1943, 1944, + 1945, 1946, 1947, 1948, 1949, 1950, 1951, 1952, 1953, 1954, 1955, 1956, + 1957, 1958, 1959, 1960, 1961, 1962, 1963, 1964, 1965, 1966, 1967, 1968, + 1969, 1970, 1971, 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, + 1981, 1982, 1983, 1984, 1985, 1986, 1987, 2119, 2140, 2143, 2147, 2153, + 2158, 2161, 2168, 2171, 2175, 2182 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band3 + coefs: [62.5] + intercept: 116812.5 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign observation error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Step 4: Create cloudFree variable + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/cloudFree + type: int + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/cloudCoverTotal + coefs: [-100] + intercept: 100 + + # Step 5: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/cloudFree + action: + name: reduce obs space + + obs post filters: + # Step 6: Wavenumber Check + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, 1981, + 1982, 1983, 1984, 1985, 1986, 1987, 2119, 2140, 2143, 2147, + 2153, 2158, 2161, 2168, 2171, 2175, 2182 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 1.0e-12 + action: + name: reject + + # Step 7: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorWavenumIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 9: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 10: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 11: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [{{ get_satellite_variable(observation_from_jcb, "icld_det") }}] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 12: Surface Temperature Jacobian Check over Land + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + test variables: + - name: ObsDiag/brightness_temperature_jacobian_skin_temperature_at_surface + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.2 + + # Step 13: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 14: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 15: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 16: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_n21.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_n21.yaml.j2 new file mode 100644 index 000000000..ad797168d --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_n21.yaml.j2 @@ -0,0 +1,379 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 +{% if rad_to_tb | default(false) %} + observed variables: [spectralRadiance] + derived variables: [brightnessTemperature] +{% endif %} + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id cris-fsr_n21 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band1 19, 24, 26, 27, 28, 31, 32, 33, 37, 39, 42, 44, 47, 49, 50, + 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, + 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, + 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, + 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, + 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, + 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, + 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, + 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, + 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, + 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 208, + 211, 216, 224, 234, 236, 238, 239, 242, 246, 248, 255, 264, 266, 268, + 275, 279, 283, 285, 291, 295, 301, 305, 311, 332, 342, 389, 400, 402, + 404, 406, 410, 427, 439, 440, 441, 445, 449, 455, 458, 461, 464, 467, + 470, 473, 475, 482, 486, 487, 490, 493, 496, 499, 501, 503, 505, 511, + 513, 514, 518, 519, 520, 522, 529, 534, 563, 568, 575, 592, 594, 596, + 598, 600, 602, 604, 611, 614, 616, 618, 620, 622, 626, 631, 638, 646, + 648, 652, 659, 673, 675, 678, 684, 688, 694, 700, 707, 710, 713 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band1 + coefs: [62.5] + intercept: 64937.5 + use channel numbers: true + + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band2 714, 718, 720, 722, 725, 728, 735, 742, 748, 753, 762, 780, 784, 798, 849, + 860, 862, 866, 874, 882, 890, 898, 906, 907, 908, 914, 937, 972, 973, + 978, 980, 981, 988, 995, 998, 1000, 1003, 1008, 1009, 1010, 1014, 1017, + 1018, 1020, 1022, 1024, 1026, 1029, 1030, 1032, 1034, 1037, 1038, 1041, + 1042, 1044, 1046, 1049, 1050, 1053, 1054, 1058, 1060, 1062, 1064, 1066, + 1069, 1076, 1077, 1080, 1086, 1091, 1095, 1101, 1109, 1112, 1121, 1128, + 1133, 1163, 1172, 1187, 1189, 1205, 1211, 1219, 1231, 1245, 1271, 1289, + 1300, 1313, 1316, 1325, 1329, 1346, 1347, 1473, 1474, 1491, 1499, 1553, + 1570 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band2 + coefs: [62.5] + intercept: 76375 + use channel numbers: true + + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band3 1596, 1602, 1619, 1624, 1635, 1939, 1940, 1941, 1942, 1943, 1944, + 1945, 1946, 1947, 1948, 1949, 1950, 1951, 1952, 1953, 1954, 1955, 1956, + 1957, 1958, 1959, 1960, 1961, 1962, 1963, 1964, 1965, 1966, 1967, 1968, + 1969, 1970, 1971, 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, + 1981, 1982, 1983, 1984, 1985, 1986, 1987, 2119, 2140, 2143, 2147, 2153, + 2158, 2161, 2168, 2171, 2175, 2182 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band3 + coefs: [62.5] + intercept: 116812.5 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign observation error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Step 4: Create cloudFree variable + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/cloudFree + type: int + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/cloudCoverTotal + coefs: [-100] + intercept: 100 + + # Step 5: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/cloudFree + action: + name: reduce obs space + + obs post filters: + # Step 6: Wavenumber Check + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, 1981, + 1982, 1983, 1984, 1985, 1986, 1987, 2119, 2140, 2143, 2147, + 2153, 2158, 2161, 2168, 2171, 2175, 2182 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 1.0e-12 + action: + name: reject + + # Step 7: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorWavenumIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 9: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 10: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 11: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [{{ get_satellite_variable(observation_from_jcb, "icld_det") }}] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 12: Surface Temperature Jacobian Check over Land + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + test variables: + - name: ObsDiag/brightness_temperature_jacobian_skin_temperature_at_surface + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.2 + + # Step 13: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 14: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 15: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 16: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_npp.yaml.j2 new file mode 100644 index 000000000..dd340d219 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_cris-fsr_npp.yaml.j2 @@ -0,0 +1,379 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 +{% if rad_to_tb | default(false) %} + observed variables: [spectralRadiance] + derived variables: [brightnessTemperature] +{% endif %} + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id cris-fsr_npp + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band1 19, 24, 26, 27, 28, 31, 32, 33, 37, 39, 42, 44, 47, 49, 50, + 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, + 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, + 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, + 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, + 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, + 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, + 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, + 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, + 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, + 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 208, + 211, 216, 224, 234, 236, 238, 239, 242, 246, 248, 255, 264, 266, 268, + 275, 279, 283, 285, 291, 295, 301, 305, 311, 332, 342, 389, 400, 402, + 404, 406, 410, 427, 439, 440, 441, 445, 449, 455, 458, 461, 464, 467, + 470, 473, 475, 482, 486, 487, 490, 493, 496, 499, 501, 503, 505, 511, + 513, 514, 518, 519, 520, 522, 529, 534, 563, 568, 575, 592, 594, 596, + 598, 600, 602, 604, 611, 614, 616, 618, 620, 622, 626, 631, 638, 646, + 648, 652, 659, 673, 675, 678, 684, 688, 694, 700, 707, 710, 713 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band1 + coefs: [62.5] + intercept: 64937.5 + use channel numbers: true + + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band2 714, 718, 720, 722, 725, 728, 735, 742, 748, 753, 762, 780, 784, 798, 849, + 860, 862, 866, 874, 882, 890, 898, 906, 907, 908, 914, 937, 972, 973, + 978, 980, 981, 988, 995, 998, 1000, 1003, 1008, 1009, 1010, 1014, 1017, + 1018, 1020, 1022, 1024, 1026, 1029, 1030, 1032, 1034, 1037, 1038, 1041, + 1042, 1044, 1046, 1049, 1050, 1053, 1054, 1058, 1060, 1062, 1064, 1066, + 1069, 1076, 1077, 1080, 1086, 1091, 1095, 1101, 1109, 1112, 1121, 1128, + 1133, 1163, 1172, 1187, 1189, 1205, 1211, 1219, 1231, 1245, 1271, 1289, + 1300, 1313, 1316, 1325, 1329, 1346, 1347, 1473, 1474, 1491, 1499, 1553, + 1570 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band2 + coefs: [62.5] + intercept: 76375 + use channel numbers: true + + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: &{{observation_from_jcb}}_band3 1596, 1602, 1619, 1624, 1635, 1939, 1940, 1941, 1942, 1943, 1944, + 1945, 1946, 1947, 1948, 1949, 1950, 1951, 1952, 1953, 1954, 1955, 1956, + 1957, 1958, 1959, 1960, 1961, 1962, 1963, 1964, 1965, 1966, 1967, 1968, + 1969, 1970, 1971, 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, + 1981, 1982, 1983, 1984, 1985, 1986, 1987, 2119, 2140, 2143, 2147, 2153, + 2158, 2161, 2168, 2171, 2175, 2182 + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_band3 + coefs: [62.5] + intercept: 116812.5 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign observation error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Step 4: Create cloudFree variable + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/cloudFree + type: int + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/cloudCoverTotal + coefs: [-100] + intercept: 100 + + # Step 5: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/cloudFree + action: + name: reduce obs space + + obs post filters: + # Step 6: Wavenumber Check + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, 1981, + 1982, 1983, 1984, 1985, 1986, 1987, 2119, 2140, 2143, 2147, + 2153, 2158, 2161, 2168, 2171, 2175, 2182 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 1.0e-12 + action: + name: reject + + # Step 7: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorWavenumIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 8: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 9: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 10: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 11: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [{{ get_satellite_variable(observation_from_jcb, "icld_det") }}] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 12: Surface Temperature Jacobian Check over Land + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + test variables: + - name: ObsDiag/brightness_temperature_jacobian_skin_temperature_at_surface + channels: *{{observation_from_jcb}}_simulated_channels + maxvalue: 0.2 + + # Step 13: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 14: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 15: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 16: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_gmi_gpm.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_gmi_gpm.yaml.j2 new file mode 100644 index 000000000..b0001fffd --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_gmi_gpm.yaml.j2 @@ -0,0 +1,431 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: &{{observation_from_jcb}}_clouds [Water, Ice, Rain, Snow, Graupel] +# Cloud_Fraction: 1.0 +# ---methods for cloud fraction and radii in fov: thompson, or none + method for cloud fraction within fov: thompson + method for hydrometeor effective radii within fov: thompson + Cloud_Seeding: true + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id gmi_gpm + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + # Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 15-207 + action: + name: reduce obs space + + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 100 + use_reduced_horizontal_grid: true + distance_norm: geodesic + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # ------------------------ + obs prior filters: + # Zero Atmospheric clouds in CRTM where water_area_fraction < 0.99 + - filter: Variable Assignment + assignments: + - name: MetaData/zeroCloudInCRTM + type: int + function: + name: ObsFunction/Conditional + options: + # firstmatchingcase: false + defaultvalue: 0 # Will not zero clouds by default + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + value: 1 # Will zero clouds by default + + obs post filters: + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 1-9 + minvalue: 50.0 + maxvalue: 320.0 + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: 10-13 + minvalue: 70.0 + maxvalue: 320.0 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/latitude + minvalue: -55.0 + maxvalue: 55.0 + - variable: + name: MetaData/heightOfSurface + maxvalue: 2000 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + - variable: + name: GeoVaLs/average_surface_temperature_within_field_of_view + minvalue: 275 + + # Toss data within a region lat: 20S - 0N deg and lon: 25E - 40E deg. (Inherited from GEOS) + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/latitude + minvalue: -20.0 + maxvalue: 0.0 + - variable: + name: MetaData/longitude + minvalue: 25.0 + maxvalue: 40.0 + + # Save CLW retrievals from ObsValue + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/clw_obs + type: float + function: + name: ObsFunction/CLWRetMW + options: + clwret_ch37v: 6 + clwret_ch37h: 7 + clwret_types: [ObsValue] + use bias-corrected HofX_at_ch37GHz: false + # Check CLW retrievals from ObsValue + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/clw_obs + maxvalue: 900 + + # Save CLW retrievals from HofX + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/clw_guess_retrieval + type: float + function: + name: ObsFunction/CLWRetMW + options: + clwret_ch37v: 6 + clwret_ch37h: 7 + clwret_types: [HofX] + use bias-corrected HofX_at_ch37GHz: false + # Ckeck CLW retrievals from Hofx + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: DerivedMetaData/clw_guess_retrieval + maxvalue: 900 + + # emiss_qc + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: DerivedMetaData/clw_obs + minvalue: 0.0 + maxvalue: 0.05 + - variable: + name: ObsFunction/Emissivity_Diff_GMI + options: + channel: 2 + regression_constant_1: 0.13290 + regression_constant_2: 0.42468 + regression_coeff_1: [-0.00548, 0.00772, 0.00530, -0.00425, + 0.00053, 0.00008, -0.00003, -0.00144, + 0.00059, -0.00016, 0.00003, -0.00011, + 0.00017] + regression_coeff_2: [0.00289, -0.00142] + minvalue: 0.01 + action: + name: reject + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: DerivedMetaData/clw_obs + minvalue: 0.0 + maxvalue: 0.05 + - variable: + name: ObsFunction/Emissivity_Diff_GMI + options: + channel: 4 + regression_constant_1: 0.15627 + regression_constant_2: 0.83807 + regression_coeff_1: [-0.01084, 0.01194, 0.01111, -0.00784, + 0.00060, 0.00008, -0.00003, -0.00248, + 0.00105, -0.00008, 0.00000, -0.00013, + 0.00016] + regression_coeff_2: [0.00048, -0.00207] + minvalue: 0.035 + action: + name: reject + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: DerivedMetaData/clw_obs + minvalue: 0.0 + maxvalue: 0.05 + - variable: + name: ObsFunction/Emissivity_Diff_GMI + options: + channel: 7 + regression_constant_1: 0.30306 + regression_constant_2: 1.24071 + regression_coeff_1: [-0.01793, 0.01730, 0.01784, -0.01199, + 0.00067, 0.00013, -0.00004, -0.00365, + 0.00154, -0.00004, -0.00001, -0.00015, + 0.00017] + regression_coeff_2: [0.00068, -0.00342] + minvalue: 0.05 + action: + name: reject + + # Assign observational error in all-sky DA. + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelRamp + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + xvar: + name: ObsFunction/CLWRetSymmetricMW + options: + clwret_ch37v: 6 + clwret_ch37h: 7 + clwret_types: [ObsValue, HofX] + use bias-corrected HofX_at_ch37GHz: false + x0: &{{observation_from_jcb}}_x0 [{{ get_satellite_variable(observation_from_jcb, "x0") }}] + x1: &{{observation_from_jcb}}_x1 [{{ get_satellite_variable(observation_from_jcb, "x1") }}] + x2: &{{observation_from_jcb}}_x2 [{{ get_satellite_variable(observation_from_jcb, "x2") }}] + err0: &{{observation_from_jcb}}_err0 [{{ get_satellite_variable(observation_from_jcb, "error") }}] + err1: &{{observation_from_jcb}}_err2 [{{ get_satellite_variable(observation_from_jcb, "error_cld1") }}] + err2: &{{observation_from_jcb}}_err1 [{{ get_satellite_variable(observation_from_jcb, "error_cld") }}] + + ## Prepare variables used by cold-air-outbreak checks in all-sky. + # Combined ColumnLiquidCloud + ColumnIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidandIceCloud + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: GeoVaLs/mass_content_of_cloud_ice_in_atmosphere_column + coefs: [1, 1] + # replace zero by 9.99e-7 in DerivedMetaData/ColumnLiquidandIceCloud + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnLiquidandIceCloud + type: float + value: 9.99e-07 + where: + - variable: + name: DerivedMetaData/ColumnLiquidandIceCloud + maxvalue: 9.99e-07 + + # ratio of liquid /(Liquid+Ice) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + function: + name: ObsFunction/ElementMultiply + options: + variables: + - name: GeoVaLs/mass_content_of_cloud_liquid_water_in_atmosphere_column + - name: DerivedMetaData/ColumnLiquidandIceCloud + exponents: [1,-1] + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ColumnRatioLiquidCloud + type: float + value: 0.0 + where: + - variable: + name: DerivedMetaData/ColumnLiquidandIceCloud + maxvalue: 1.0e-06 + + # TotalColumnVaporGuess + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/TotalColumnVaporGuess + type: float + function: + name: ObsFunction/TotalColumnVaporGuess + + # potentialTemperature at surface + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureSurface + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: true + # potentialTemperature near 700 hPa + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + type: float + function: + name: PotentialTemperatureFromTemperature@ObsFunction + options: + use surface pressure: false + pressure to evaluate potential temperature: 70000.0 + # stability = Difference between PotentialTemperatur values + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/PotentialTemperatureDiff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/PotentialTemperatureAt700hPa + - name: DerivedMetaData/PotentialTemperatureSurface + coefs: [1, -1] + # cold-air-outbreak (cao) check for all-sky DA with Rain, Snow, or Graupel + - filter: BlackList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: ObsFunction/TotalColumnVaporGuess + maxvalue: 8.0 + - variable: + name: DerivedMetaData/ColumnRatioLiquidCloud + maxvalue: 0.5 + - variable: + name: DerivedMetaData/PotentialTemperatureDiff + maxvalue: 12.0 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + threshold: 2.0 + absolute threshold vector: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-a.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-a.yaml.j2 new file mode 100644 index 000000000..21b7f984c --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-a.yaml.j2 @@ -0,0 +1,320 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 +{% if rad_to_tb | default(false) %} + observed variables: [spectralRadiance] + derived variables: [brightnessTemperature] +{% endif %} + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id iasi_metop-a + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: *{{observation_from_jcb}}_simulated_channels + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [25.0] + intercept: 64475.0 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Step 4: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 5-56 + action: + name: reduce obs space + + # Step 5: Create cloudFree variable (for thinning) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/cloudFree + type: int + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/cloudFree + coefs: [100] + + # Step 6: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/cloudFree + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 7: Wavenumber Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 7024, 7027, 7029, 7032, 7038, 7043, 7046, 7049, 7069, 7072, 7076, + 7081, 7084, 7089, 7099, 7209, 7222, 7231, 7235, 7247, 7267, 7269, 7284, 7389, + 7419, 7423, 7424, 7426, 7428, 7431, 7436, 7444, 7475, 7549, 7584, 7665, 7666, + 7831, 7836, 7853, 7865, 7885, 7888, 7912, 7950, 7972, 7980, 7995, 8007, 8015, + 8055, 8078 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 1.0e-12 + action: + name: reject + + # Step 8: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorWavenumIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 9: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 10: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 11: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 12: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [{{ get_satellite_variable(observation_from_jcb, "icld_det") }}] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 13: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 14: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 15: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 16: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-b.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-b.yaml.j2 new file mode 100644 index 000000000..8719b610a --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-b.yaml.j2 @@ -0,0 +1,320 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 +{% if rad_to_tb | default(false) %} + observed variables: [spectralRadiance] + derived variables: [brightnessTemperature] +{% endif %} + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id iasi_metop-b + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: *{{observation_from_jcb}}_simulated_channels + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [25.0] + intercept: 64475.0 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Step 4: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 5-56 + action: + name: reduce obs space + + # Step 5: Create cloudFree variable (for thinning) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/cloudFree + type: int + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/cloudFree + coefs: [100] + + # Step 6: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/cloudFree + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 7: Wavenumber Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 7024, 7027, 7029, 7032, 7038, 7043, 7046, 7049, 7069, 7072, 7076, + 7081, 7084, 7089, 7099, 7209, 7222, 7231, 7235, 7247, 7267, 7269, 7284, 7389, + 7419, 7423, 7424, 7426, 7428, 7431, 7436, 7444, 7475, 7549, 7584, 7665, 7666, + 7831, 7836, 7853, 7865, 7885, 7888, 7912, 7950, 7972, 7980, 7995, 8007, 8015, + 8055, 8078 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 1.0e-12 + action: + name: reject + + # Step 8: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorWavenumIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 9: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 10: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 11: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 12: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [{{ get_satellite_variable(observation_from_jcb, "icld_det") }}] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 13: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 14: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 15: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 16: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-c.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-c.yaml.j2 new file mode 100644 index 000000000..2aeb580b6 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_iasi_metop-c.yaml.j2 @@ -0,0 +1,320 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 +{% if rad_to_tb | default(false) %} + observed variables: [spectralRadiance] + derived variables: [brightnessTemperature] +{% endif %} + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id iasi_metop-c + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + order: 4 + - name: sensorScanAngle + order: 3 + - name: sensorScanAngle + order: 2 + - name: sensorScanAngle + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Step 1: Create Derived Variables + # Assign channel wavenumbers in m-1 + - filter: Variable Assignment + assignments: + - name: MetaData/sensorCentralWavenumber + type: float + channels: *{{observation_from_jcb}}_simulated_channels + function: + name: ObsFunction/LinearCombination + options: + variables: + - name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + coefs: [25.0] + intercept: 64475.0 + use channel numbers: true + + # Step 2: Transform radiance to brightness temperature + - filter: Variable Transforms + Transform: SatBrightnessTempFromRad + transform from: + name: ObsValue/spectralRadiance + channels: *{{observation_from_jcb}}_simulated_channels + spectral variable: + name: MetaData/sensorCentralWavenumber + channels: *{{observation_from_jcb}}_simulated_channels + radiance units: wavenumber + planck1: 1.191042953e-16 + planck2: 1.4387774e-2 + + # Step 3: Assign Observation Error + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Step 4: Remove Observations from the Edge of the Scan + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 5-56 + action: + name: reduce obs space + + # Step 5: Create cloudFree variable (for thinning) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/cloudFree + type: int + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/cloudFree + coefs: [100] + + # Step 6: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/cloudFree + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Step 7: Wavenumber Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 7024, 7027, 7029, 7032, 7038, 7043, 7046, 7049, 7069, 7072, 7076, + 7081, 7084, 7089, 7099, 7209, 7222, 7231, 7235, 7247, 7267, 7269, 7284, 7389, + 7419, 7423, 7424, 7426, 7428, 7431, 7436, 7444, 7475, 7549, 7584, 7665, 7666, + 7831, 7836, 7853, 7865, 7885, 7888, 7912, 7950, 7972, 7980, 7995, 8007, 8015, + 8055, 8078 + where: + - variable: + name: MetaData/solarZenithAngle + maxvalue: 88.9999 + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 1.0e-12 + action: + name: reject + + # Step 8: Observation Error Inflation based on Wavenumber + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorWavenumIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 9: Observation Range Sanity Check + # Valid range: (50, 550) + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 50.00001 + maxvalue: 549.99999 + action: + name: reject + + # Step 10: Topography Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 11: Transmittance Top Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 12: Cloud Detection Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [{{ get_satellite_variable(observation_from_jcb, "icld_det") }}] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + error parameter vector: *{{observation_from_jcb}}_oberr + maxvalue: 1.0e-12 + action: + name: reject + + # Step 13: NSST Retrieval Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + maxvalue: 1.0e-12 + action: + name: reject + + # Step 14: Surface Jacobians Check + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.50, 2.00, 4.00, 2.00, 4.00] + sensor: *{{observation_from_jcb}}_sensor_id + + # Step 15: Gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [25.0, 0.5, 0.04, 1.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_oberr + action: + name: reject + + # Step 16: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_seviri_m08.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_seviri_m08.yaml.j2 new file mode 100644 index 000000000..11a3221c6 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_seviri_m08.yaml.j2 @@ -0,0 +1,503 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id seviri_m08 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs prior filters: + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_err [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceFlag + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 4 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 0 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 1 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 2 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 3 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceParam + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 0 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 30 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 15 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 20 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 15 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/thinningCriteria + type: int + function: + name: IntObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/surfaceParam + coefs: [1] + + obs post filters: + #Step1: Satellite Zenith Angle Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: MetaData/sensorZenithAngle + maxvalue: 65. + action: + name: reject + +#Step2:Clear-sky fraction check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: MetaData/cloudAmount + maxvalue: 30. + action: + name: reject + +#Step3: Scene homogeneous check + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 5 + is_defined: + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 6 + is_defined: + where operator: and + + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 5 + maxvalue: 1.3 + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 6 + maxvalue: 1.3 + where operator: and + + +#Step4: Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: maximum + time_mesh: 'PT06H' + time_min: '2021-07-31T21:00:00Z' + time_max: '2021-08-01T03:00:00Z' + priority_variable: DerivedMetaData/thinningCriteria + action: + name: reject + +#Step5: Surface type check +# Reject channels 5-6 over land-dominant area + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 4, 7-11 + where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/land_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/ice_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/surface_snow_area_fraction + maxvalue: 0.99 + max_exclusive: true + +#Step6: Terrain Check: Do not use when height > 1km + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/surface_geopotential_height + maxvalue: 1000.0 + +#Step7: BT range check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 0.0 + maxvalue: 1000.0 + action: + name: reject + +#Step 8: Error Inflation based on topography + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorFactorTopo + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: seviri_m08 + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: DerivedMetaData/ObsErrorFactorTopo + channels: *{{observation_from_jcb}}_simulated_channels + +#Step9: Error Inflation based on TOA transmittance + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + +#Step10: Cloud detection + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [-2, -2, -2, -2, -2, -2, -2, -2, -2, -2] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + error parameter vector: *{{observation_from_jcb}}_err + maxvalue: 1.0e-12 + action: + name: reject + +#Step11: Scene Consistency Check based on ch9 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 4, 6-11 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 9 + maxvalue: 0.5 + max_exclusive: true + +#Step12: Gross check + # Reject channels 4, 6-11 if omf > 2 + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: 4, 6-11 + absolute threshold: 2.0 + action: + name: reject + +#Step 13: Error inflation for channels 3-4 based on scene consistency from channel 5 + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + maxvalue: 0.5 + minvalue: 0.4 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.14891 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + maxvalue: 0.6 + max_exclusive: true + minvalue: 0.5 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.29228 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + maxvalue: 0.7 + max_exclusive: true + minvalue: 0.6 + action: + name: inflate error + inflation factor: 1.49666 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + minvalue: 0.7 + action: + name: inflate error + inflation factor: 1.51987 + +#Step14: Near SST Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + maxvalue: 1.0e-12 + action: + name: reject + +#Step15: Surface Jacobian + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + +#Step16: Channels 4, 6-11 Cloud fraction >2 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 4, 6-11 + where: + - variable: + name: MetaData/cloudAmount + maxvalue: 2 + +#Step17: Final gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [0.0, 0.0, 0.0, 0.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_err + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 + diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_seviri_m11.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_seviri_m11.yaml.j2 new file mode 100644 index 000000000..c8b3c8bfc --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_seviri_m11.yaml.j2 @@ -0,0 +1,503 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + Clouds: [Water, Ice] + Cloud_Fraction: 1.0 + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id seviri_m11 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variational bc: + predictors: + - name: constant + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Filters (QC) + # ------------------------ + obs prior filters: + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_err [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceFlag + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 4 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 0 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 1 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 2 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 3 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/surfaceParam + type: int + function: + name: IntObsFunction/Conditional + options: + defaultvalue: 0 + firstmatchingcase: true + cases: + - where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + value: 30 + - where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + value: 15 + - where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + value: 20 + - where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + value: 15 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/thinningCriteria + type: int + function: + name: IntObsFunction/Arithmetic + options: + variables: + - name: DerivedMetaData/surfaceParam + coefs: [1] + + obs post filters: + #Step1: Satellite Zenith Angle Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: MetaData/sensorZenithAngle + maxvalue: 65. + action: + name: reject + +#Step2:Clear-sky fraction check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: MetaData/cloudAmount + maxvalue: 30. + action: + name: reject + +#Step3: Scene homogeneous check + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 5 + is_defined: + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 6 + is_defined: + where operator: and + + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 5 + maxvalue: 1.3 + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 6 + maxvalue: 1.3 + where operator: and + + +#Step4: Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: maximum + time_mesh: 'PT06H' + time_min: '2021-07-31T21:00:00Z' + time_max: '2021-08-01T03:00:00Z' + priority_variable: DerivedMetaData/thinningCriteria + action: + name: reject + +#Step5: Surface type check +# Reject channels 5-6 over land-dominant area + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 4, 7-11 + where: + - variable: + name: GeoVaLs/land_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/surface_snow_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/ice_area_fraction + minvalue: 0.99 + + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/land_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/ice_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/surface_snow_area_fraction + maxvalue: 0.99 + max_exclusive: true + +#Step6: Terrain Check: Do not use when height > 1km + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/surface_geopotential_height + maxvalue: 1000.0 + +#Step7: BT range check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + minvalue: 0.0 + maxvalue: 1000.0 + action: + name: reject + +#Step 8: Error Inflation based on topography + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorFactorTopo + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/ObsErrorFactorTopoRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: seviri_m11 + channels: *{{observation_from_jcb}}_simulated_channels + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: DerivedMetaData/ObsErrorFactorTopo + channels: *{{observation_from_jcb}}_simulated_channels + +#Step9: Error Inflation based on TOA transmittance + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + +#Step10: Cloud detection + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/CloudDetectMinResidualIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + use_flag_clddet: [-2, -2, -2, -2, -2, -2, -2, -2, -2, -2] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + error parameter vector: *{{observation_from_jcb}}_err + maxvalue: 1.0e-12 + action: + name: reject + +#Step11: Scene Consistency Check based on ch9 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 4, 6-11 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature + channels: 9 + maxvalue: 0.5 + max_exclusive: true + +#Step12: Gross check + # Reject channels 4, 6-11 if omf > 2 + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: 4, 6-11 + absolute threshold: 2.0 + action: + name: reject + +#Step 13: Error inflation for channels 3-4 based on scene consistency from channel 5 + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + maxvalue: 0.5 + minvalue: 0.4 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.14891 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + maxvalue: 0.6 + max_exclusive: true + minvalue: 0.5 + min_exclusive: true + action: + name: inflate error + inflation factor: 1.29228 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + maxvalue: 0.7 + max_exclusive: true + minvalue: 0.6 + action: + name: inflate error + inflation factor: 1.49666 + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: 6-7 + where: + - variable: + name: ClearSkyStdDev/brightnessTemperature_5 + minvalue: 0.7 + action: + name: inflate error + inflation factor: 1.51987 + +#Step14: Near SST Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/NearSSTRetCheckIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: *{{observation_from_jcb}}_active_channels + maxvalue: 1.0e-12 + action: + name: reject + +#Step15: Surface Jacobian + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + sensor: *{{observation_from_jcb}}_sensor_id + obserr_demisf: [0.01, 0.02, 0.03, 0.02, 0.03] + obserr_dtempf: [0.5, 2.0, 4.0, 2.0, 4.0] + +#Step16: Channels 4, 6-11 Cloud fraction >2 + - filter: Domain Check + filter variables: + - name: brightnessTemperature + channels: 4, 6-11 + where: + - variable: + name: MetaData/cloudAmount + maxvalue: 2 + +#Step17: Final gross check + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + function absolute threshold: + - name: ObsFunction/ObsErrorBoundIR + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_latitude: + name: ObsFunction/ObsErrorFactorLatRad + options: + latitude_parameters: [0.0, 0.0, 0.0, 0.0] + obserr_bound_transmittop: + name: ObsFunction/ObsErrorFactorTransmitTopRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + obserr_bound_max: [{{ get_satellite_variable(observation_from_jcb, "ermax") }}] + error parameter vector: *{{observation_from_jcb}}_err + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 + diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_ssmis_f17.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_ssmis_f17.yaml.j2 new file mode 100644 index 000000000..7cb077bf1 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_ssmis_f17.yaml.j2 @@ -0,0 +1,871 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id ssmis_f17 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: cloudWaterContent + sensor: SSMIS + ch19h: 12 + ch19v: 13 + ch22v: 14 + ch37h: 15 + ch37v: 16 + ch91v: 17 + ch91h: 18 + - name: cosineOfLatitudeTimesOrbitNode + - name: sineOfLatitude + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ------------------------------ + obs pre filters: + # Step 1: Remove missing data from the obs space + - filter: RejectList + where: + - variable: + name: ObsValue/brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + value: is_not_valid + action: + name: reduce obs space + + # Step 2: Create thinning scores based on surface types + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 0 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 5, 7, 10 # ocean/water + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 0 , 12 # land + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 85 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 3, 4, 9 # Ice/Sea Ice/Frozen Soil + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 90 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 8, 11 # Snow + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 85 + + # Step 3: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/thinningScore + action: + name: reduce obs space + + # Step 4: Initial Observation Error Assignment + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # Step 5: Gross check over water-dominant area + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + absolute threshold: 3.5 + remove bias correction: true + where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # Step 6: Reject all channels if surface height is greater than 2km + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/geopotential_height_at_surface + minvalue: 2000.0 + min_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + + # Step 7: Reject data over mixed surface type + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 1-3,8-18 + where: + - variable: + name: GeoVaLs/land_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/ice_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/surface_snow_area_fraction + maxvalue: 0.99 + max_exclusive: true + + # Step 8: Channel 2 O-F check over non-water dominant area + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 1-2, 12-16 + reference: ObsValue/brightnessTemperature_2 + value: HofX/brightnessTemperature_2 + minvalue: -1.5 + maxvalue: 1.5 + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + + # Step 9: Gross check over non-water dominant area + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + absolute threshold: 3.5 + remove bias correction: true + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + action: + name: reject + + # Step 10: Scattering check for channels 9-11 using channels 8 and 17 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/SSMISScatteringIndex9 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: HofX/brightnessTemperature_17 + - name: ObsBiasData/brightnessTemperature_17 + - name: HofX/brightnessTemperature_8 + - name: ObsBiasData/brightnessTemperature_8 + coefs: [-0.485934, 0.485934, 0.473806, -0.473806] + intercept: 271.252327 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/SSMISScatteringIndex10 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: HofX/brightnessTemperature_17 + - name: ObsBiasData/brightnessTemperature_17 + - name: HofX/brightnessTemperature_8 + - name: ObsBiasData/brightnessTemperature_8 + coefs: [-0.413688, 0.413688, 0.361549, -0.361549] + intercept: 272.280341 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/SSMISScatteringIndex11 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: HofX/brightnessTemperature_17 + - name: ObsBiasData/brightnessTemperature_17 + - name: HofX/brightnessTemperature_8 + - name: ObsBiasData/brightnessTemperature_8 + coefs: [-0.400882, 0.400882, 0.270510, -0.270510] + intercept: 278.824902 + + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 9 + reference: ObsValue/brightnessTemperature_9 + value: DerivedMetaData/SSMISScatteringIndex9 + maxvalue: 2 + + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 10 + reference: ObsValue/brightnessTemperature_10 + value: DerivedMetaData/SSMISScatteringIndex10 + maxvalue: 2 + + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 11 + reference: ObsValue/brightnessTemperature_11 + value: DerivedMetaData/SSMISScatteringIndex11 + maxvalue: 2 + + # Step 11: Error inflation based on surface jacobian + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorFactorSurfJacobian + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.010, 0.010, 0.010, 0.010] + obserr_dtempf: [0.500, 0.500, 0.500, 0.500, 0.500] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: DerivedMetaData/ObsErrorFactorSurfJacobian + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 12: Final gross check + # Channel 1 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor1 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_1 + coefs: [ 2.25 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_1 + threshold: DerivedMetaData/errorInflationFactor1 + absolute threshold: 6.0 + action: + name: reject + + # Channel 2 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor2 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_2 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_2 + threshold: DerivedMetaData/errorInflationFactor2 + absolute threshold: 6.0 + action: + name: reject + + # Channel 3 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor3 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_3 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_3 + threshold: DerivedMetaData/errorInflationFactor3 + absolute threshold: 6.0 + action: + name: reject + + # Channel 4 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor4 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_4 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_4 + threshold: DerivedMetaData/errorInflationFactor4 + absolute threshold: 6.0 + action: + name: reject + + # Channel 5 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor5 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_5 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_5 + threshold: DerivedMetaData/errorInflationFactor5 + absolute threshold: 6.0 + action: + name: reject + + # Channel 6 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor6 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_6 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_6 + threshold: DerivedMetaData/errorInflationFactor6 + absolute threshold: 6.0 + action: + name: reject + + # Channel 7 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor7 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_7 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_7 + threshold: DerivedMetaData/errorInflationFactor7 + absolute threshold: 6.0 + action: + name: reject + + # Channel 8 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor8 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_8 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_8 + threshold: DerivedMetaData/errorInflationFactor8 + absolute threshold: 6.0 + action: + name: reject + + # Channel 9 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor9 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_9 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_9 + threshold: DerivedMetaData/errorInflationFactor9 + absolute threshold: 6.0 + action: + name: reject + + # Channel 10 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor10 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_10 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_10 + threshold: DerivedMetaData/errorInflationFactor10 + absolute threshold: 6.0 + action: + name: reject + + # Channel 11 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor11 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_11 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_11 + threshold: DerivedMetaData/errorInflationFactor11 + absolute threshold: 6.0 + action: + name: reject + + # Channel 12 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor12 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_12 + coefs: [ 3.60 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_12 + threshold: DerivedMetaData/errorInflationFactor12 + absolute threshold: 6.0 + action: + name: reject + + # Channel 13 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor13 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_13 + coefs: [ 1.905 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_13 + threshold: DerivedMetaData/errorInflationFactor13 + absolute threshold: 6.0 + action: + name: reject + + # Channel 14 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor14 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_14 + coefs: [ 2.16 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_14 + threshold: DerivedMetaData/errorInflationFactor14 + absolute threshold: 6.0 + action: + name: reject + + # Channel 15 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor15 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_15 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_15 + threshold: DerivedMetaData/errorInflationFactor15 + absolute threshold: 6.0 + action: + name: reject + + # Channel 16 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor16 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_16 + coefs: [ 2.01 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_16 + threshold: DerivedMetaData/errorInflationFactor16 + absolute threshold: 6.0 + action: + name: reject + + # Channel 17 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor17 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_17 + coefs: [ 2.61 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_17 + threshold: DerivedMetaData/errorInflationFactor17 + absolute threshold: 6.0 + action: + name: reject + + # Channel 18 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor18 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_18 + coefs: [ 5.625 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_18 + threshold: DerivedMetaData/errorInflationFactor18 + absolute threshold: 6.0 + action: + name: reject + + # Channel 19 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor19 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_19 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_19 + threshold: DerivedMetaData/errorInflationFactor19 + absolute threshold: 6.0 + action: + name: reject + + # Channel 20 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor20 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_20 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_20 + threshold: DerivedMetaData/errorInflationFactor20 + absolute threshold: 6.0 + action: + name: reject + + # Channel 21 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor21 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_21 + coefs: [ 3.00 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_21 + threshold: DerivedMetaData/errorInflationFactor21 + absolute threshold: 6.0 + action: + name: reject + + # Channel 22 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor22 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_22 + coefs: [ 9.60 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_22 + threshold: DerivedMetaData/errorInflationFactor22 + absolute threshold: 6.0 + action: + name: reject + + # Channel 23 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor23 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_23 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_23 + threshold: DerivedMetaData/errorInflationFactor23 + absolute threshold: 6.0 + action: + name: reject + + # Channel 24 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor24 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_24 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_24 + threshold: DerivedMetaData/errorInflationFactor24 + absolute threshold: 6.0 + action: + name: reject + + # Step 13: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 126336 diff --git a/parm/jcb-gdas/observations/atmosphere/radiance_ssmis_f18.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/radiance_ssmis_f18.yaml.j2 new file mode 100644 index 000000000..9b99a5c64 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/radiance_ssmis_f18.yaml.j2 @@ -0,0 +1,871 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [brightnessTemperature] + channels: &{{observation_from_jcb}}_simulated_channels {{ get_satellite_variable(observation_from_jcb, "simulated") }} + + # Observation Operator + # -------------------- + obs operator: + name: CRTM + Absorbers: [H2O, O3, CO2] + obs options: + Sensor_ID: &{{observation_from_jcb}}_sensor_id ssmis_f18 + EndianType: little_endian + CoefficientPath: "{{crtm_coefficient_path}}" + linear obs operator: + Absorbers: [H2O, O3] + + # Observation Bias Correction (VarBC) + # ----------------------------------- + obs bias: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiasin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasin_suffix}}" + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiasout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiasout_suffix}}" + variables without bc: [brightnessTemperature] + channels: {{ get_satellite_variable(observation_from_jcb, "not_biascorrtd") }} + variational bc: + predictors: + - name: constant + - name: cloudWaterContent + sensor: SSMIS + ch19h: 12 + ch19v: 13 + ch22v: 14 + ch37h: 15 + ch37v: 16 + ch91v: 17 + ch91h: 18 + - name: cosineOfLatitudeTimesOrbitNode + - name: sineOfLatitude + - name: lapseRate + order: 2 + tlapse: &{{observation_from_jcb}}_tlapse "{{atmosphere_obsbiasin_path}}/{{atmosphere_obstlapsein_prefix}}{{observation_from_jcb}}{{atmosphere_obstlapsein_suffix}}" + - name: lapseRate + tlapse: *{{observation_from_jcb}}_tlapse + - name: emissivityJacobian + - name: sensorScanAngle + var_name: sensorScanPosition + order: 4 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 3 + - name: sensorScanAngle + var_name: sensorScanPosition + order: 2 + - name: sensorScanAngle + var_name: sensorScanPosition + covariance: + minimal required obs number: 20 + variance range: [1.0e-6, 10.0] + step size: 1.0e-4 + largest analysis variance: 10000.0 + prior: + input file: "{{atmosphere_obsbiasin_path}}/{{atmosphere_obsbiascovin_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovin_suffix}}" + inflation: + ratio: 1.1 + ratio for small dataset: 2.0 + output file: "{{atmosphere_obsbiasout_path}}/{{atmosphere_obsbiascovout_prefix}}{{observation_from_jcb}}{{atmosphere_obsbiascovout_suffix}}" + + # Observation Pre Filters (QC) + # ------------------------------ + obs pre filters: + # Step 1: Remove missing data from the obs space + - filter: RejectList + where: + - variable: + name: ObsValue/brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + value: is_not_valid + action: + name: reduce obs space + + # Step 2: Create thinning scores based on surface types + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 0 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 5, 7, 10 # ocean/water + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 100 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 0 , 12 # land + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 85 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 3, 4, 9 # Ice/Sea Ice/Frozen Soil + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 90 + + - filter: Variable Assignment + where: + - variable: + name: MetaData/earthSurfaceType + is_in: 8, 11 # Snow + assignments: + - name: DerivedMetaData/thinningScore + type: int + value: 85 + + # Step 3: Data Thinning + - filter: Gaussian Thinning + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + horizontal_mesh: 145 + use_reduced_horizontal_grid: true + distance_norm: geodesic + priority_variable: DerivedMetaData/thinningScore + action: + name: reduce obs space + + # Step 4: Initial Observation Error Assignment + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: assign error + error parameter vector: &{{observation_from_jcb}}_oberr [{{ get_satellite_variable(observation_from_jcb, "error") }}] + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # Step 5: Gross check over water-dominant area + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + absolute threshold: 3.5 + remove bias correction: true + where: + - variable: + name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # Step 6: Reject all channels if surface height is greater than 2km + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + where: + - variable: + name: GeoVaLs/geopotential_height_at_surface + minvalue: 2000.0 + min_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + + # Step 7: Reject data over mixed surface type + - filter: RejectList + filter variables: + - name: brightnessTemperature + channels: 1-3,8-18 + where: + - variable: + name: GeoVaLs/land_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/ice_area_fraction + maxvalue: 0.99 + max_exclusive: true + - variable: + name: GeoVaLs/surface_snow_area_fraction + maxvalue: 0.99 + max_exclusive: true + + # Step 8: Channel 2 O-F check over non-water dominant area + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 1-2, 12-16 + reference: ObsValue/brightnessTemperature_2 + value: HofX/brightnessTemperature_2 + minvalue: -1.5 + maxvalue: 1.5 + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + + # Step 9: Gross check over non-water dominant area + - filter: Background Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + absolute threshold: 3.5 + remove bias correction: true + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + max_exclusive: true + action: + name: reject + + # Step 10: Scattering check for channels 9-11 using channels 8 and 17 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/SSMISScatteringIndex9 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: HofX/brightnessTemperature_17 + - name: ObsBiasData/brightnessTemperature_17 + - name: HofX/brightnessTemperature_8 + - name: ObsBiasData/brightnessTemperature_8 + coefs: [-0.485934, 0.485934, 0.473806, -0.473806] + intercept: 271.252327 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/SSMISScatteringIndex10 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: HofX/brightnessTemperature_17 + - name: ObsBiasData/brightnessTemperature_17 + - name: HofX/brightnessTemperature_8 + - name: ObsBiasData/brightnessTemperature_8 + coefs: [-0.413688, 0.413688, 0.361549, -0.361549] + intercept: 272.280341 + + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/SSMISScatteringIndex11 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: HofX/brightnessTemperature_17 + - name: ObsBiasData/brightnessTemperature_17 + - name: HofX/brightnessTemperature_8 + - name: ObsBiasData/brightnessTemperature_8 + coefs: [-0.400882, 0.400882, 0.270510, -0.270510] + intercept: 278.824902 + + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 9 + reference: ObsValue/brightnessTemperature_9 + value: DerivedMetaData/SSMISScatteringIndex9 + maxvalue: 2 + + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 10 + reference: ObsValue/brightnessTemperature_10 + value: DerivedMetaData/SSMISScatteringIndex10 + maxvalue: 2 + + - filter: Difference Check + filter variables: + - name: brightnessTemperature + channels: 11 + reference: ObsValue/brightnessTemperature_11 + value: DerivedMetaData/SSMISScatteringIndex11 + maxvalue: 2 + + # Step 11: Error inflation based on surface jacobian + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/ObsErrorFactorSurfJacobian + channels: *{{observation_from_jcb}}_simulated_channels + type: float + function: + name: ObsFunction/ObsErrorFactorSurfJacobianRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + sensor: *{{observation_from_jcb}}_sensor_id + channels: *{{observation_from_jcb}}_simulated_channels + obserr_demisf: [0.010, 0.010, 0.010, 0.010, 0.010] + obserr_dtempf: [0.500, 0.500, 0.500, 0.500, 0.500] + + - filter: Perform Action + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + action: + name: inflate error + inflation variable: + name: DerivedMetaData/ObsErrorFactorSurfJacobian + channels: *{{observation_from_jcb}}_simulated_channels + + # Step 12: Final gross check + # Channel 1 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor1 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_1 + coefs: [ 2.25 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_1 + threshold: DerivedMetaData/errorInflationFactor1 + absolute threshold: 6.0 + action: + name: reject + + # Channel 2 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor2 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_2 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_2 + threshold: DerivedMetaData/errorInflationFactor2 + absolute threshold: 6.0 + action: + name: reject + + # Channel 3 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor3 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_3 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_3 + threshold: DerivedMetaData/errorInflationFactor3 + absolute threshold: 6.0 + action: + name: reject + + # Channel 4 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor4 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_4 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_4 + threshold: DerivedMetaData/errorInflationFactor4 + absolute threshold: 6.0 + action: + name: reject + + # Channel 5 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor5 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_5 + coefs: [ 0.75 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_5 + threshold: DerivedMetaData/errorInflationFactor5 + absolute threshold: 6.0 + action: + name: reject + + # Channel 6 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor6 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_6 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_6 + threshold: DerivedMetaData/errorInflationFactor6 + absolute threshold: 6.0 + action: + name: reject + + # Channel 7 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor7 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_7 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_7 + threshold: DerivedMetaData/errorInflationFactor7 + absolute threshold: 6.0 + action: + name: reject + + # Channel 8 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor8 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_8 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_8 + threshold: DerivedMetaData/errorInflationFactor8 + absolute threshold: 6.0 + action: + name: reject + + # Channel 9 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor9 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_9 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_9 + threshold: DerivedMetaData/errorInflationFactor9 + absolute threshold: 6.0 + action: + name: reject + + # Channel 10 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor10 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_10 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_10 + threshold: DerivedMetaData/errorInflationFactor10 + absolute threshold: 6.0 + action: + name: reject + + # Channel 11 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor11 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_11 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_11 + threshold: DerivedMetaData/errorInflationFactor11 + absolute threshold: 6.0 + action: + name: reject + + # Channel 12 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor12 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_12 + coefs: [ 3.60 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_12 + threshold: DerivedMetaData/errorInflationFactor12 + absolute threshold: 6.0 + action: + name: reject + + # Channel 13 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor13 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_13 + coefs: [ 1.905 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_13 + threshold: DerivedMetaData/errorInflationFactor13 + absolute threshold: 6.0 + action: + name: reject + + # Channel 14 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor14 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_14 + coefs: [ 2.16 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_14 + threshold: DerivedMetaData/errorInflationFactor14 + absolute threshold: 6.0 + action: + name: reject + + # Channel 15 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor15 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_15 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_15 + threshold: DerivedMetaData/errorInflationFactor15 + absolute threshold: 6.0 + action: + name: reject + + # Channel 16 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor16 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_16 + coefs: [ 2.01 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_16 + threshold: DerivedMetaData/errorInflationFactor16 + absolute threshold: 6.0 + action: + name: reject + + # Channel 17 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor17 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_17 + coefs: [ 2.61 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_17 + threshold: DerivedMetaData/errorInflationFactor17 + absolute threshold: 6.0 + action: + name: reject + + # Channel 18 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor18 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_18 + coefs: [ 5.625 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_18 + threshold: DerivedMetaData/errorInflationFactor18 + absolute threshold: 6.0 + action: + name: reject + + # Channel 19 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor19 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_19 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_19 + threshold: DerivedMetaData/errorInflationFactor19 + absolute threshold: 6.0 + action: + name: reject + + # Channel 20 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor20 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_20 + coefs: [ 4.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_20 + threshold: DerivedMetaData/errorInflationFactor20 + absolute threshold: 6.0 + action: + name: reject + + # Channel 21 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor21 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_21 + coefs: [ 3.00 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_21 + threshold: DerivedMetaData/errorInflationFactor21 + absolute threshold: 6.0 + action: + name: reject + + # Channel 22 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor22 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_22 + coefs: [ 9.60 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_22 + threshold: DerivedMetaData/errorInflationFactor22 + absolute threshold: 6.0 + action: + name: reject + + # Channel 23 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor23 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_23 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_23 + threshold: DerivedMetaData/errorInflationFactor23 + absolute threshold: 6.0 + action: + name: reject + + # Channel 24 + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/errorInflationFactor24 + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: + - name: ObsErrorData/brightnessTemperature_24 + coefs: [ 1.50 ] + exponents: [ -1 ] + + - filter: Background Check + filter variables: + - name: brightnessTemperature_24 + threshold: DerivedMetaData/errorInflationFactor24 + absolute threshold: 6.0 + action: + name: reject + + # Step 13: Useflag Check + - filter: Bounds Check + filter variables: + - name: brightnessTemperature + channels: *{{observation_from_jcb}}_simulated_channels + test variables: + - name: ObsFunction/ChannelUseflagCheckRad + channels: *{{observation_from_jcb}}_simulated_channels + options: + channels: *{{observation_from_jcb}}_simulated_channels + use_flag: &{{observation_from_jcb}}_active_channels [{{ get_satellite_variable(observation_from_jcb, "active") }}] + minvalue: 1.0e-12 + action: + name: reject + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 126336 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-16.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-16.yaml.j2 new file mode 100644 index 000000000..e6ddcd6c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-16.yaml.j2 @@ -0,0 +1,607 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 240 (GOES SWIR): Assigned all dummy values in prepobs_errtable.global + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + + # Type 245 (GOES LWIR): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 245 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 246 (GOES cloud-top WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 247 (GOES clear-sky WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 251 (GOES VIS): Assigned all dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 251 (VIS) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # Reject obs with pressure < 12500 pa --- obs tosed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 12500. + action: + name: reject + + # Exclude data over non-water surface type where latitude > 20N for Type 240 (IRSW) and Type 245 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240, 245 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 90. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 90. + maxvalue: 100. + action: + name: reject + + # Reject obs with pressure < 15000 pa. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 15000. + action: + name: reject + + # Reject obs with pressure < 70000 pa. when Type=251 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 251 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # Reject obs with pressure > 30000. when Type=246 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 246 + test variables: + - name: MetaData/pressure + maxvalue: 30000. + action: + name: reject + + # Reject obs with pressure > 85000. when isli=1 (land surface) + # Notes: Replace land_type_index_NPOESS with land_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: GeoVaLs/land_area_fraction + minvalue: 0.99 + test variables: + - name: MetaData/pressure + maxvalue: 85000. + action: + name: reject + + # Reject obs with pct1 (Coeff. of Var.) outside of 0.04–0.5, Type [240,245,246,251] ONLY + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 240, 245, 246, 251 + test variables: + - name: MetaData/coefficientOfVariation + minvalue: 0.04 + maxvalue: 0.5 + action: + name: reject + + # NESDIS obs are also subject to the experr_norm test defined as: + # + # if (10. - 0.1*(expectedError))/(ob_speed)>0.9, or ob_speed<0.1, reject, applies to NESDIS winds + # + # CLEARED: With caveat that float precision/handling differences can generate different acceptance criteria + # between UFO and GSI for observations with an experr_norm value right around the maxvalue. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: ObsFunction/SatWindsErrnormCheck + maxvalue: 0.9 + action: + name: reject + + # Reject all Type=240 (GOES SWIR) AMVs: These are not currently assimilated in GSI and they have missing-values + # assigned to ob-errors + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # GOES IR (245) reject when pressure between 399 and 801 mb. + # # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 39901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 245 + action: + name: reject + + # GOES WV (246, 250, 254), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246, 250, 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # GOES (247) reject any observation with a /=0 surface type (non-water + # surface) within 110 hPa of the surface pressure (as part of the LNVD # check). + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # Notes (eliu): Replace land_type_index_NPOESS with land_area_fraction. + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 247 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -11000. # within 110 hPa above surface pressure, negative p-diff + action: + name: reject + + # Reject GOES (247) when difference of wind direction is more than 50 degrees. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + test variables: + - name: ObsFunction/WindDirAngleDiff + maxvalue: 50. + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-17.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-17.yaml.j2 new file mode 100644 index 000000000..e6ddcd6c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-17.yaml.j2 @@ -0,0 +1,607 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 240 (GOES SWIR): Assigned all dummy values in prepobs_errtable.global + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + + # Type 245 (GOES LWIR): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 245 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 246 (GOES cloud-top WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 247 (GOES clear-sky WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 251 (GOES VIS): Assigned all dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 251 (VIS) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # Reject obs with pressure < 12500 pa --- obs tosed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 12500. + action: + name: reject + + # Exclude data over non-water surface type where latitude > 20N for Type 240 (IRSW) and Type 245 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240, 245 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 90. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 90. + maxvalue: 100. + action: + name: reject + + # Reject obs with pressure < 15000 pa. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 15000. + action: + name: reject + + # Reject obs with pressure < 70000 pa. when Type=251 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 251 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # Reject obs with pressure > 30000. when Type=246 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 246 + test variables: + - name: MetaData/pressure + maxvalue: 30000. + action: + name: reject + + # Reject obs with pressure > 85000. when isli=1 (land surface) + # Notes: Replace land_type_index_NPOESS with land_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: GeoVaLs/land_area_fraction + minvalue: 0.99 + test variables: + - name: MetaData/pressure + maxvalue: 85000. + action: + name: reject + + # Reject obs with pct1 (Coeff. of Var.) outside of 0.04–0.5, Type [240,245,246,251] ONLY + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 240, 245, 246, 251 + test variables: + - name: MetaData/coefficientOfVariation + minvalue: 0.04 + maxvalue: 0.5 + action: + name: reject + + # NESDIS obs are also subject to the experr_norm test defined as: + # + # if (10. - 0.1*(expectedError))/(ob_speed)>0.9, or ob_speed<0.1, reject, applies to NESDIS winds + # + # CLEARED: With caveat that float precision/handling differences can generate different acceptance criteria + # between UFO and GSI for observations with an experr_norm value right around the maxvalue. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: ObsFunction/SatWindsErrnormCheck + maxvalue: 0.9 + action: + name: reject + + # Reject all Type=240 (GOES SWIR) AMVs: These are not currently assimilated in GSI and they have missing-values + # assigned to ob-errors + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # GOES IR (245) reject when pressure between 399 and 801 mb. + # # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 39901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 245 + action: + name: reject + + # GOES WV (246, 250, 254), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246, 250, 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # GOES (247) reject any observation with a /=0 surface type (non-water + # surface) within 110 hPa of the surface pressure (as part of the LNVD # check). + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # Notes (eliu): Replace land_type_index_NPOESS with land_area_fraction. + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 247 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -11000. # within 110 hPa above surface pressure, negative p-diff + action: + name: reject + + # Reject GOES (247) when difference of wind direction is more than 50 degrees. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + test variables: + - name: ObsFunction/WindDirAngleDiff + maxvalue: 50. + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-18.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-18.yaml.j2 new file mode 100644 index 000000000..e6ddcd6c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_abi_goes-18.yaml.j2 @@ -0,0 +1,607 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 240 (GOES SWIR): Assigned all dummy values in prepobs_errtable.global + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + + # Type 245 (GOES LWIR): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 245 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 246 (GOES cloud-top WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 247 (GOES clear-sky WV): I am assuming these are halved relative to prepobs_errtable.global, based on read_satwnd.f90: L1410–1416 + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.6, 7.8, 7.8, 8., 8., 8.2, + 10., 12., 12.6, 13.2, 14., 14., 14., 14., 14., 14., 14., 14., 14., 14., + 14., 14., 14., 14., 14., 14.] + + # Type 251 (GOES VIS): Assigned all dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 0.] #Pressure (Pa) + errors: [1000000000., 1000000000.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 251 (VIS) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 251 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # Reject obs with pressure < 12500 pa --- obs tosed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 12500. + action: + name: reject + + # Exclude data over non-water surface type where latitude > 20N for Type 240 (IRSW) and Type 245 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240, 245 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 90. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 90. + maxvalue: 100. + action: + name: reject + + # Reject obs with pressure < 15000 pa. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: MetaData/pressure + minvalue: 15000. + action: + name: reject + + # Reject obs with pressure < 70000 pa. when Type=251 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 251 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # Reject obs with pressure > 30000. when Type=246 + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 246 + test variables: + - name: MetaData/pressure + maxvalue: 30000. + action: + name: reject + + # Reject obs with pressure > 85000. when isli=1 (land surface) + # Notes: Replace land_type_index_NPOESS with land_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: GeoVaLs/land_area_fraction + minvalue: 0.99 + test variables: + - name: MetaData/pressure + maxvalue: 85000. + action: + name: reject + + # Reject obs with pct1 (Coeff. of Var.) outside of 0.04–0.5, Type [240,245,246,251] ONLY + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + - variable: ObsType/windEastward + is_in: 240, 245, 246, 251 + test variables: + - name: MetaData/coefficientOfVariation + minvalue: 0.04 + maxvalue: 0.5 + action: + name: reject + + # NESDIS obs are also subject to the experr_norm test defined as: + # + # if (10. - 0.1*(expectedError))/(ob_speed)>0.9, or ob_speed<0.1, reject, applies to NESDIS winds + # + # CLEARED: With caveat that float precision/handling differences can generate different acceptance criteria + # between UFO and GSI for observations with an experr_norm value right around the maxvalue. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/satelliteIdentifier + is_in: 250-299 + test variables: + - name: ObsFunction/SatWindsErrnormCheck + maxvalue: 0.9 + action: + name: reject + + # Reject all Type=240 (GOES SWIR) AMVs: These are not currently assimilated in GSI and they have missing-values + # assigned to ob-errors + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240 + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # GOES IR (245) reject when pressure between 399 and 801 mb. + # # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 39901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 245 + action: + name: reject + + # GOES WV (246, 250, 254), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 246, 250, 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # GOES (247) reject any observation with a /=0 surface type (non-water + # surface) within 110 hPa of the surface pressure (as part of the LNVD # check). + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # Notes (eliu): Replace land_type_index_NPOESS with land_area_fraction. + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 247 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -11000. # within 110 hPa above surface pressure, negative p-diff + action: + name: reject + + # Reject GOES (247) when difference of wind direction is more than 50 degrees. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 247 + test variables: + - name: ObsFunction/WindDirAngleDiff + maxvalue: 50. + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_ahi_h8.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_ahi_h8.yaml.j2 new file mode 100644 index 000000000..9ec989945 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_ahi_h8.yaml.j2 @@ -0,0 +1,465 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Pre Filters (QC) + # ----------------------------- + obs pre filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 242 (Himawari VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 242 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 250 (Himawari AHI WV, cloud-top or clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 250 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 7., 7.3, 7.6, 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., + 8., 8., 8.] + + # Type Type 252 (Himawari AHI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 252 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 250 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 250 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. (also > 100., which is missing data) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + +# # Reject Type 252 (IR) winds with a /=0 surface type (non-water surface) when latitude > 20. +# - filter: Bounds Check +# filter variables: +# - name: windEastward +# - name: windNorthward +# where: +# - variable: +# name: GeoVaLs/water_area_fraction +# maxvalue: 0.99 +# - variable: +# name: ObsType/windEastward +# is_in: 252 +# test variables: +# - name: MetaData/latitude +# maxvalue: 20. +# action: +# name: reject + + # THINNING: Himawari winds are not prioritized + - filter: Gaussian Thinning + horizontal_mesh: 100 + vertical_mesh: 10000 + where: + - variable: + name: MetaData/pressure + minvalue: 50001. + action: + name: reduce obs space + + - filter: Gaussian Thinning + horizontal_mesh: 90 + vertical_mesh: 10000 + where: + - variable: + name: MetaData/pressure + maxvalue: 50000. + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Reject Type 252 (IR) winds with a /=0 surface type (non-water surface) when latitude > 20. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 252 + test variables: + - name: MetaData/latitude + maxvalue: 20. + action: + name: reject + + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # GSI setupw routine QC + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # IR (Type 242), reject when pressure is less than 700 mb + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 242 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # cloud-top WV (Type 250), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 250 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # JMA IR (252) reject when pressure between 499 and 801 mb. + # PERFORM ACTION: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 49901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 252 + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_ahi_h9.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_ahi_h9.yaml.j2 new file mode 100644 index 000000000..9ec989945 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_ahi_h9.yaml.j2 @@ -0,0 +1,465 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Pre Filters (QC) + # ----------------------------- + obs pre filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 242 (Himawari VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 242 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 250 (Himawari AHI WV, cloud-top or clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 250 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 7., 7.3, 7.6, 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., 8., + 8., 8., 8.] + + # Type Type 252 (Himawari AHI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 252 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 250 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 250 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. (also > 100., which is missing data) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + +# # Reject Type 252 (IR) winds with a /=0 surface type (non-water surface) when latitude > 20. +# - filter: Bounds Check +# filter variables: +# - name: windEastward +# - name: windNorthward +# where: +# - variable: +# name: GeoVaLs/water_area_fraction +# maxvalue: 0.99 +# - variable: +# name: ObsType/windEastward +# is_in: 252 +# test variables: +# - name: MetaData/latitude +# maxvalue: 20. +# action: +# name: reject + + # THINNING: Himawari winds are not prioritized + - filter: Gaussian Thinning + horizontal_mesh: 100 + vertical_mesh: 10000 + where: + - variable: + name: MetaData/pressure + minvalue: 50001. + action: + name: reduce obs space + + - filter: Gaussian Thinning + horizontal_mesh: 90 + vertical_mesh: 10000 + where: + - variable: + name: MetaData/pressure + maxvalue: 50000. + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Reject Type 252 (IR) winds with a /=0 surface type (non-water surface) when latitude > 20. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + - variable: + name: ObsType/windEastward + is_in: 252 + test variables: + - name: MetaData/latitude + maxvalue: 20. + action: + name: reject + + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # GSI setupw routine QC + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # IR (Type 242), reject when pressure is less than 700 mb + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 242 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # cloud-top WV (Type 250), reject when pressure greater than 399 mb. + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 250 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # JMA IR (252) reject when pressure between 499 and 801 mb. + # PERFORM ACTION: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 49901. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 252 + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-a.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-a.yaml.j2 new file mode 100755 index 000000000..d95a8b0c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-a.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 244 (AVHRR LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 244 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-b.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-b.yaml.j2 new file mode 100755 index 000000000..d95a8b0c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-b.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 244 (AVHRR LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 244 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-c.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-c.yaml.j2 new file mode 100755 index 000000000..d95a8b0c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_metop-c.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 244 (AVHRR LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 244 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n15.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n15.yaml.j2 new file mode 100644 index 000000000..d95a8b0c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n15.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 244 (AVHRR LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 244 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n18.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n18.yaml.j2 new file mode 100644 index 000000000..d95a8b0c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n18.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 244 (AVHRR LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 244 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n19.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n19.yaml.j2 new file mode 100644 index 000000000..d95a8b0c9 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_avhrr_n19.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 244 (AVHRR LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 244 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_leogeo_multi.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_leogeo_multi.yaml.j2 new file mode 100644 index 000000000..1aaa0fda0 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_leogeo_multi.yaml.j2 @@ -0,0 +1,261 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 255 (LEOGEO LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 255 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_modis_aqua.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_modis_aqua.yaml.j2 new file mode 100644 index 000000000..0971bf8fe --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_modis_aqua.yaml.j2 @@ -0,0 +1,357 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 257 (MODIS LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 257 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # Type 258 (MODIS WVCT): Some levels assigned dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 258 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [1000000000.,1000000000.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # Type 259 (MODIS WVDL): Some levels assigned dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 259 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [1000000000.,1000000000.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # MODIS-Aqua/Terra (257) and (259), reject when pressure less than 249 mb. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 257,259 + test variables: + - name: MetaData/pressure + minvalue: 24900. + action: + name: reject + + # MODIS-Aqua/Terra (258) and (259), reject when pressure greater than 600 mb. + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 258, 259 + test variables: + - name: MetaData/pressure + maxvalue: 60000. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_modis_terra.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_modis_terra.yaml.j2 new file mode 100644 index 000000000..434a0f671 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_modis_terra.yaml.j2 @@ -0,0 +1,369 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 257 (MODIS LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 257 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # Type 258 (MODIS WVCT): Some levels assigned dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 258 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [1000000000.,1000000000.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # Type 259 (MODIS WVDL): Some levels assigned dummy values + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 259 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] #Pressure (Pa) + errors: [1000000000.,1000000000.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # MODIS-TERRA: reject any WVCT (258) or WVDL (259) satwind + # NOTE: This restriction does NOT apply to MODIS-AQUA + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 258,259 + action: + name: reject + + # MODIS-Aqua/Terra (257) and (259), reject when pressure less than 249 mb. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 257,259 + test variables: + - name: MetaData/pressure + minvalue: 24900. + action: + name: reject + + # MODIS-Aqua/Terra (258) and (259), reject when pressure greater than 600 mb. + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + # maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 258, 259 + test variables: + - name: MetaData/pressure + maxvalue: 60000. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m10.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m10.yaml.j2 new file mode 100644 index 000000000..11306468d --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m10.yaml.j2 @@ -0,0 +1,472 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI"s thinning of SEVIRI/METEOSAT-10 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #758 for details: https://github.com/NOAA-EMC/GDASApp/issues/758 + #obs pre filters: + #- filter: Gaussian Thinning + # where: + # - variable: ObsType/windEastward + # is_in: 243, 253 + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + # Observation Pre Filters (QC) + # ----------------------------- + obs pre filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 243 (MVIRI/SEVIRI VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 253 (MVIRI/SEVERI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 254 (MVIRI/SEVIRI WV, both cloud-top and clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4.5, 6.1, + 6., 6.5, 7.3, 7.6, 7., 7.5, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 254 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 254 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + + # THINNING: METEOSAT winds are prioritized by qiWithoutForecast + - filter: Gaussian Thinning + horizontal_mesh: 100 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: + name: MetaData/pressure + minvalue: 50001. + action: + name: reduce obs space + + - filter: Gaussian Thinning + horizontal_mesh: 90 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: + name: MetaData/pressure + maxvalue: 50000. + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Exclude data over non-water surface type where latitude > 20N for Type 253 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # EUMETSAT IR (253) reject when pressure between 401 and 801 mb. + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 40101. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 253 + action: + name: reject + + # EUMET VIS (243) reject when pressure less than 700 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # EUMET WV (254) reject when pressure greater than 399 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m11.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m11.yaml.j2 new file mode 100644 index 000000000..afb74befc --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m11.yaml.j2 @@ -0,0 +1,472 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI"s thinning of SEVIRI/METEOSAT-11 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #758 for details: https://github.com/NOAA-EMC/GDASApp/issues/758 + #obs pre filters: + #- filter: Gaussian Thinning + # where: + # - variable: ObsType/windEastward + # is_in: 243, 253 + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + # Observation Pre Filters (QC) + # ----------------------------- + obs pre filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 243 (MVIRI/SEVIRI VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 253 (MVIRI/SEVERI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 254 (MVIRI/SEVIRI WV, both cloud-top and clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4.5, 6.1, + 6., 6.5, 7.3, 7.6, 7., 7.5, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 254 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 254 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + + # THINNING: METEOSAT winds are prioritized by qiWithoutForecast + - filter: Gaussian Thinning + horizontal_mesh: 100 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: + name: MetaData/pressure + minvalue: 50001. + action: + name: reduce obs space + + - filter: Gaussian Thinning + horizontal_mesh: 90 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: + name: MetaData/pressure + maxvalue: 50000. + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Exclude data over non-water surface type where latitude > 20N for Type 253 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # EUMETSAT IR (253) reject when pressure between 401 and 801 mb. + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 40101. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 253 + action: + name: reject + + # EUMET VIS (243) reject when pressure less than 700 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # EUMET WV (254) reject when pressure greater than 399 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m8.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m8.yaml.j2 new file mode 100644 index 000000000..0135ab4fd --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m8.yaml.j2 @@ -0,0 +1,476 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI"s thinning of SEVIRI/METEOSAT-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #758 for details: https://github.com/NOAA-EMC/GDASApp/issues/758 + #obs pre filters: + #- filter: Gaussian Thinning + # where: + # - variable: ObsType/windEastward + # is_in: 243, 253 + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + # Observation Pre Filters (QC) + # ----------------------------- + obs pre filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 243 (MVIRI/SEVIRI VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 253 (MVIRI/SEVERI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 254 (MVIRI/SEVIRI WV, both cloud-top and clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4.5, 6.1, + 6., 6.5, 7.3, 7.6, 7., 7.5, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 254 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 254 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + + # THINNING: METEOSAT-8 Type-243/253 winds are thinned using priority_variable=MetaData/qiWithoutForecast + # METEOSAT-8 Type-254 winds are NOT thinned + - filter: Gaussian Thinning + horizontal_mesh: 100 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: ObsType/windEastward + is_in: 243,253 + - variable: + name: MetaData/pressure + minvalue: 50001. + action: + name: reduce obs space + + - filter: Gaussian Thinning + horizontal_mesh: 90 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: ObsType/windEastward + is_in: 243,253 + - variable: + name: MetaData/pressure + maxvalue: 50000. + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Exclude data over non-water surface type where latitude > 20N for Type 253 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # EUMETSAT IR (253) reject when pressure between 401 and 801 mb. + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 40101. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 253 + action: + name: reject + + # EUMET VIS (243) reject when pressure less than 700 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # EUMET WV (254) reject when pressure greater than 399 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m9.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m9.yaml.j2 new file mode 100644 index 000000000..b7e6b094a --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_seviri_m9.yaml.j2 @@ -0,0 +1,476 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI"s thinning of SEVIRI/METEOSAT-9 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #758 for details: https://github.com/NOAA-EMC/GDASApp/issues/758 + #obs pre filters: + #- filter: Gaussian Thinning + # where: + # - variable: ObsType/windEastward + # is_in: 243, 253 + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + # Observation Pre Filters (QC) + # ----------------------------- + obs pre filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + # Type 243 (MVIRI/SEVIRI VIS) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 253 (MVIRI/SEVERI LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4., 4.1, + 5., 6., 6.3, 6.6, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # Type 254 (MVIRI/SEVIRI WV, both cloud-top and clear-sky) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + minvalue: -135. + maxvalue: 135. + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000., 105000., 100000., 95000., 90000., 85000., 80000., 75000., + 70000., 65000., 60000., 55000., 50000., 45000., 40000., 35000., 30000., + 25000., 20000., 15000., 10000., 7500., 5000., 4000., 3000., 2000., 1000., + 500., 400., 300., 200., 100., 0.] #Pressure (Pa) + errors: [3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.8, 3.9, 3.9, 4., 4.5, 6.1, + 6., 6.5, 7.3, 7.6, 7., 7.5, 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., 7., + 7., 7., 7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # GSI read routine QC (part-1) + # Exclude Type 254 with windComputationMethod==5 (clear-sky WV) --- obs tossed without passing to setup routine + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windNorthward + is_in: 254 + - variable: MetaData/windComputationMethod + is_in: 5 + action: + name: reject + + # Exclude data with satellite zenith angle > 68 for all types --- obs tossed without passing to setup routine + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/satelliteZenithAngle + maxvalue: 68. + action: + name: reject + + # GSI read routine QC (part-2) + # Reject obs with qiWithoutForecast < 85. OR > 100. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: MetaData/qiWithoutForecast + minvalue: 85. + maxvalue: 100. + action: + name: reject + + # THINNING: METEOSAT-9 Type-243/253 winds are thinned using priority_variable=MetaData/qiWithoutForecast + # METEOSAT-9 Type-254 winds are NOT thinned + - filter: Gaussian Thinning + horizontal_mesh: 100 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: ObsType/windEastward + is_in: 243,253 + - variable: + name: MetaData/pressure + minvalue: 50001. + action: + name: reduce obs space + + - filter: Gaussian Thinning + horizontal_mesh: 90 + vertical_mesh: 10000 + priority_variable: + name: MetaData/qiWithoutForecast + where: + - variable: ObsType/windEastward + is_in: 243,253 + - variable: + name: MetaData/pressure + maxvalue: 50000. + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + # Exclude data over non-water surface type where latitude > 20N for Type 253 (IRLW) --- obs tossed and not passed to setup routine + # Notes: This check was missing, so added (eliu) + # Replace land_type_index_NPOSS with water_area_fraction (eliu) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 253 + - variable: MetaData/latitude + minvalue: 20. + test variables: + - name: GeoVaLs/water_area_fraction + minvalue: 0.99 + action: + name: reject + + # Observation Post Filters (QC) + # ------------------------------ + obs post filters: + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # EUMETSAT IR (253) reject when pressure between 401 and 801 mb. + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: MetaData/pressure + minvalue: 40101. + maxvalue: 80099. + - variable: ObsType/windEastward + is_in: 253 + action: + name: reject + + # EUMET VIS (243) reject when pressure less than 700 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 243 + test variables: + - name: MetaData/pressure + minvalue: 70000. + action: + name: reject + + # EUMET WV (254) reject when pressure greater than 399 mb. + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 254 + test variables: + - name: MetaData/pressure + maxvalue: 39900. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, + 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, + 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, + 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, + 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_viirs_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_viirs_n20.yaml.j2 new file mode 100644 index 000000000..5fc941577 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_viirs_n20.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 260 (VIIRS LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 260 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_amv_viirs_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_viirs_npp.yaml.j2 new file mode 100644 index 000000000..5fc941577 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_amv_viirs_npp.yaml.j2 @@ -0,0 +1,290 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + linear obs operator: + name: VertInterp + + # NOTE: Tests using the Gaussian Thinning filter (below) to duplicate GSI's thinning of AHI/Himawari-8 satwinds + # results in more JEDI satwinds in the diag file than in GSI, but far fewer JEDI satwinds assimilated than + # GSI. JEDI under-counts assimilated winds by roughly 25-40%, relative to GSI, and this under-count is not + # even including the temporal thinning which is applied in GSI but not JEDI (by this filter below). See + # GDASApp Issue #741 for details: https://github.com/NOAA-EMC/GDASApp/issues/741 + #obs pre filters: + #- filter: Gaussian Thinning + # horizontal_mesh: 200 + # vertical_mesh: 10000 + # use_reduced_horizontal_grid: true + # round_horizontal_bin_count_to_nearest: true + # partition_longitude_bins_using_mesh: true + + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: False + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + + obs post filters: + # Assign the initial observation error, based on height/pressure + # Hard-wiring to prepobs_errtable.global by Type + # ObsError is currently not updating in diag file, but passes directly to EffectiveError when no inflation is specified in YAML + + # Type 260 (VIIRS LWIR) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 260 + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [110000.,105000.,100000.,95000.,90000.,85000.,80000.,75000.,70000.,65000.,60000.,55000.,50000.,45000.,40000.,35000.,30000.,25000.,20000.,15000.,10000.,7500.,5000.,4000.,3000.,2000.,1000.,500.,400.,300.,200.,100.,0.] + errors: [3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.8,3.9,3.9,4.,4.,4.1,5.,6.,6.3,6.6,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.,7.] + + # sanity-check criteria + # Observation Range Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + minvalue: -130. + maxvalue: 130. + action: + name: reject + + # Velocity Sanity Check + # NOT EXPLICITLY CLEARED: No obs in this range in file, so 0 Bounds Check rejects (which is correct) but essentially untested + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Velocity + maxvalue: 130. + action: + name: reject + + # Reject any observation with a /=0 surface type (non-water surface) within + # 200 hPa of the surface pressure (as part of the LNVD check). + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: + name: GeoVaLs/water_area_fraction + maxvalue: 0.99 + reference: GeoVaLs/air_pressure_at_surface + value: MetaData/pressure + maxvalue: -20000. # within 200 hPa above surface pressure, negative p-diff + action: + name: reject + + # LNVD check + # CLEARED: maxvalue is rejecting >, not >= as per a Perform Action, so threshold is unchanged + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/SatWindsLNVDCheck + maxvalue: 3. + action: + name: reject + + # GSI setupw routine QC + # Reject any ob Type [240–260] when pressure greater than 950 mb. + # CLEARED: minvalue/maxvalue are >=/<=, not >/<, so editing range by 1 Pa + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 240-260 + test variables: + - name: MetaData/pressure + maxvalue: 95001. + action: + name: reject + + # Multiple satellite platforms, reject when pressure is more than 50 mb above tropopause. + # CLEARED: minvalue is rejecting <, not <= as per a Perform Action, so threshold is unchanged + # Notes (eliu): This tropopause check reject too many obs; probably due to tropopause pressure estimation + # Turn this check off for now. + # Need to check if troposphere pressure was implemented correctly in fv3-jed + - filter: Difference Check + filter variables: + - name: windEastward + - name: windNorthward + reference: GeoVaLs/tropopause_pressure + value: MetaData/pressure + minvalue: -5000. # 50 hPa above tropopause level, negative p-diff + action: + name: reject + + # All satwinds must adjust errors based on ObsErrorFactorPressureCheck + # prior to the SPDB check (i.e. the gross-error check). The gross-error + # check uses the adjusted errors for error-bound tightening and rejection, + # so this check has to come first. This check will inflate errors for obs + # that are too close to either the model top or bottom. + # Notes (eliu): GMAO added a required parameter: adjusted_error_name. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + surface_obs: false + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 240-260 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All satwinds subject to a gross-error check that contains significant + # modifiers for satwinds with a negative speed-bias. ALL wind gross-error + # checks are currently being done by the SatWindsSPDBCheck. + # CLEARED + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [ 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256, 257, 258, 259, 260] + cgross: [ 2.5, 2.5, 2.5, 1.5, 2.5, 1.3, 1.3, 2.5, 2.5, 2.5, 2.5, 1.3, 2.5, 1.5, 1.5, 2.5, 2.5, 2.5, 2.5, 2.5, 2.5] + error_min: [1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4, 1.4] + error_max: [6.1, 6.1, 15.0, 15.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.0, 20.1, 20.1, 20.1, 20.1, 20.1, 20.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don't want to inflate errors for duplication if one + # of the duplicates should be rejected. + # Notes (eliu): ObsErrorFactorDuplicateCheck obsfunction requires PreUseFlag (usage parameter from read_satwnd.f90). + # : Turn off duplicate check for now. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + + # We are extending this to an additional filter that inflates final ob-errors across-the-board by + # 1/0.8 = 1.25. This is caused by the GSI value of nvqc being set to .true. in the global operational + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this nvqc functionality were to be switched off (i.e. if variational qc were to be turned off), + # you would want to remove this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 240-260 + # action: + # name: inflate error + # inflation factor: 1.25 + + # End of Filters diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-a.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-a.yaml.j2 new file mode 100644 index 000000000..f7eb43944 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-a.yaml.j2 @@ -0,0 +1,316 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + # Use height vertical coordinate first + # vertical coordinate: geometric_height + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + hofx scaling field: SurfaceWindScalingHeight + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + - filter: Gaussian Thinning + horizontal_mesh: 75 + use_reduced_horizontal_grid: true + round_horizontal_bin_count_to_nearest: true + partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for rescaled height coordinate + - filter: Variable Transforms + Transform: AdjustedHeightCoordinate + SkipWhenNoObs: false + + # Apply variable changes needed for wind scaling + - filter: Variable Transforms + Transform: SurfaceWindScalingHeight + SkipWhenNoObs: false + + # Assign the initial observation error (constant value, 1.5 m/s right now). + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 1.5 + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + # Reject all obs with PreQC mark already set above 3 + # NOTE: All scatwinds have an automatic PreQC mark of 2 (hard-wired default from GSI) + # - filter: PreQC + # maxvalue: 3 + # action: + # name: reject + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Reject all ASCAT (Type 290) winds with tsavg <= 273.0 (surface temperature) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + # - variable: GeoVaLs/surface_temperature + - variable: GeoVaLs/skin_temperature_at_surface_where_land + maxvalue: 273. + action: + name: reject + + # Reject all ASCAT (Type 290) winds with isflg /= 0 (non-water surface) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + - variable: GeoVaLs/water_area_fraction + maxvalue: 0.99 + action: + name: reject + + # Reject ASCAT (Type 290) when observed component deviates from background by more than 5.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windEastward + - name: HofX/windEastward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windNorthward + - name: HofX/windNorthward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + # Reject OSCAT (Type 291) when observed component deviates from background by more than 6.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Background Check + filter variables: + - name: windEastward + - name: windNorthward + threshold: 6. + absolute threshold: 6. + where: + - variable: ObsType/windEastward + is_in: 291 + action: + name: reject + + # Reject ASCAT (Type 290) when ambiguity check fails (returned value is negative) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + test variables: + - name: ObsFunction/ScatWindsAmbiguityCheck + options: + minimum_uv: 0.0001 # hard-coding a minimum-uv for transparancy, want this to basically be zero + maxvalue: 0. + action: + name: reject + + # All scatwinds must adjust errors based on ObsErrorFactorPressureCheck. + # This check will inflate errors for obs that are too close to either + # the model top or bottom. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All scatwinds subject to a gross error check. This is contained within + # the WindsSPDBCheck, although it is not exclusive to satwinds. + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # There is no across-the-board inflation for nvqc=.true. for scatwinds, presumably because for + # this inflation to take place both nvqc must be .true. AND ibeta must be >0, see: + # https://github.com/NOAA-EMC/GSI/blob/14ae595af1b03471287d322596d35c0665336e95/src/gsi/setupw.f90#L1229 + # GSI settings must have ibeta>0 for satwinds, but not for scatwinds. + # + # If the ibeta settings for scatwinds were to change while nvqc remained .true., we would extend YAML to + # an additional filter that inflates final ob-errors across-the-board by 1/0.8 = 1.25. NOTE: the nvqc setting + # is defaulted to .false. in GSI code, but is overridden in global operational configuration. See: + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this functionality were to be activated for scatwinds, you would want to include this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + # END OF FILTERS# + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-b.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-b.yaml.j2 new file mode 100644 index 000000000..f7eb43944 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-b.yaml.j2 @@ -0,0 +1,316 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + # Use height vertical coordinate first + # vertical coordinate: geometric_height + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + hofx scaling field: SurfaceWindScalingHeight + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + - filter: Gaussian Thinning + horizontal_mesh: 75 + use_reduced_horizontal_grid: true + round_horizontal_bin_count_to_nearest: true + partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for rescaled height coordinate + - filter: Variable Transforms + Transform: AdjustedHeightCoordinate + SkipWhenNoObs: false + + # Apply variable changes needed for wind scaling + - filter: Variable Transforms + Transform: SurfaceWindScalingHeight + SkipWhenNoObs: false + + # Assign the initial observation error (constant value, 1.5 m/s right now). + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 1.5 + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + # Reject all obs with PreQC mark already set above 3 + # NOTE: All scatwinds have an automatic PreQC mark of 2 (hard-wired default from GSI) + # - filter: PreQC + # maxvalue: 3 + # action: + # name: reject + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Reject all ASCAT (Type 290) winds with tsavg <= 273.0 (surface temperature) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + # - variable: GeoVaLs/surface_temperature + - variable: GeoVaLs/skin_temperature_at_surface_where_land + maxvalue: 273. + action: + name: reject + + # Reject all ASCAT (Type 290) winds with isflg /= 0 (non-water surface) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + - variable: GeoVaLs/water_area_fraction + maxvalue: 0.99 + action: + name: reject + + # Reject ASCAT (Type 290) when observed component deviates from background by more than 5.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windEastward + - name: HofX/windEastward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windNorthward + - name: HofX/windNorthward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + # Reject OSCAT (Type 291) when observed component deviates from background by more than 6.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Background Check + filter variables: + - name: windEastward + - name: windNorthward + threshold: 6. + absolute threshold: 6. + where: + - variable: ObsType/windEastward + is_in: 291 + action: + name: reject + + # Reject ASCAT (Type 290) when ambiguity check fails (returned value is negative) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + test variables: + - name: ObsFunction/ScatWindsAmbiguityCheck + options: + minimum_uv: 0.0001 # hard-coding a minimum-uv for transparancy, want this to basically be zero + maxvalue: 0. + action: + name: reject + + # All scatwinds must adjust errors based on ObsErrorFactorPressureCheck. + # This check will inflate errors for obs that are too close to either + # the model top or bottom. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All scatwinds subject to a gross error check. This is contained within + # the WindsSPDBCheck, although it is not exclusive to satwinds. + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # There is no across-the-board inflation for nvqc=.true. for scatwinds, presumably because for + # this inflation to take place both nvqc must be .true. AND ibeta must be >0, see: + # https://github.com/NOAA-EMC/GSI/blob/14ae595af1b03471287d322596d35c0665336e95/src/gsi/setupw.f90#L1229 + # GSI settings must have ibeta>0 for satwinds, but not for scatwinds. + # + # If the ibeta settings for scatwinds were to change while nvqc remained .true., we would extend YAML to + # an additional filter that inflates final ob-errors across-the-board by 1/0.8 = 1.25. NOTE: the nvqc setting + # is defaulted to .false. in GSI code, but is overridden in global operational configuration. See: + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this functionality were to be activated for scatwinds, you would want to include this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + # END OF FILTERS# + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-c.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-c.yaml.j2 new file mode 100644 index 000000000..f7eb43944 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_osw_ascat_metop-c.yaml.j2 @@ -0,0 +1,316 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + # Use height vertical coordinate first + # vertical coordinate: geometric_height + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + hofx scaling field: SurfaceWindScalingHeight + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + vertical coordinate: geopotential_height + observation vertical coordinate group: DerivedVariables + observation vertical coordinate: adjustedHeight + interpolation method: linear + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + - filter: Gaussian Thinning + horizontal_mesh: 75 + use_reduced_horizontal_grid: true + round_horizontal_bin_count_to_nearest: true + partition_longitude_bins_using_mesh: true + action: + name: reduce obs space + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for rescaled height coordinate + - filter: Variable Transforms + Transform: AdjustedHeightCoordinate + SkipWhenNoObs: false + + # Apply variable changes needed for wind scaling + - filter: Variable Transforms + Transform: SurfaceWindScalingHeight + SkipWhenNoObs: false + + # Assign the initial observation error (constant value, 1.5 m/s right now). + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + action: + name: assign error + error parameter: 1.5 + + # Calculate error inflation factor for duplicate observations + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windEastward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windEastward + #- filter: Variable Assignment + # assignments: + # - name: ObsErrorFactorDuplicateCheck/windNorthward + # type: float + # function: + # name: ObsFunction/ObsErrorFactorDuplicateCheck + # options: + # use_air_pressure: true + # variable: windNorthward + # Reject all obs with PreQC mark already set above 3 + # NOTE: All scatwinds have an automatic PreQC mark of 2 (hard-wired default from GSI) + # - filter: PreQC + # maxvalue: 3 + # action: + # name: reject + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Reject all ASCAT (Type 290) winds with tsavg <= 273.0 (surface temperature) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + # - variable: GeoVaLs/surface_temperature + - variable: GeoVaLs/skin_temperature_at_surface_where_land + maxvalue: 273. + action: + name: reject + + # Reject all ASCAT (Type 290) winds with isflg /= 0 (non-water surface) + - filter: Perform Action + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + - variable: GeoVaLs/water_area_fraction + maxvalue: 0.99 + action: + name: reject + + # Reject ASCAT (Type 290) when observed component deviates from background by more than 5.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windEastward + - name: HofX/windEastward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + test variables: + - name: ObsFunction/Arithmetic + options: + variables: + - name: ObsValue/windNorthward + - name: HofX/windNorthward + coefs: [1.0, -1.0] + minvalue: -5.0 + maxvalue: 5.0 + + # Reject OSCAT (Type 291) when observed component deviates from background by more than 6.0 m/s + # NOTE: This check can reject a u- or v-component of the same observation independently, which + # is fundamentally different from how GSI rejects obs (both components are rejected if + # either component fails a check). + - filter: Background Check + filter variables: + - name: windEastward + - name: windNorthward + threshold: 6. + absolute threshold: 6. + where: + - variable: ObsType/windEastward + is_in: 291 + action: + name: reject + + # Reject ASCAT (Type 290) when ambiguity check fails (returned value is negative) + - filter: Bounds Check + filter variables: + - name: windEastward + - name: windNorthward + where: + - variable: ObsType/windEastward + is_in: 290 + test variables: + - name: ObsFunction/ScatWindsAmbiguityCheck + options: + minimum_uv: 0.0001 # hard-coding a minimum-uv for transparancy, want this to basically be zero + maxvalue: 0. + action: + name: reject + + # All scatwinds must adjust errors based on ObsErrorFactorPressureCheck. + # This check will inflate errors for obs that are too close to either + # the model top or bottom. + - filter: Perform Action + filter variables: + - name: windEastward + where: + - variable: + name: ObsType/windEastward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windEastward + inflation factor: 4.0 + + - filter: Perform Action + filter variables: + - name: windNorthward + where: + - variable: + name: ObsType/windNorthward + is_in: 290-291 + action: + name: inflate error + inflation variable: + name: ObsFunction/ObsErrorFactorPressureCheck + options: + variable: windNorthward + inflation factor: 4.0 + + # All scatwinds subject to a gross error check. This is contained within + # the WindsSPDBCheck, although it is not exclusive to satwinds. + - filter: Background Check + filter variables: + - name: windEastward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windEastward + action: + name: reject + + - filter: Background Check + filter variables: + - name: windNorthward + function absolute threshold: + - name: ObsFunction/WindsSPDBCheck + options: + wndtype: [290, 291] + cgross: [5.0, 5.0] + error_min: [1.4, 1.4] + error_max: [6.1, 6.1] + variable: windNorthward + action: + name: reject + + # The last error inflation check is for duplicate observations. This one needs + # to come last, because we don"t want to inflate errors for duplication if one + # of the duplicates should be rejected. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windEastward + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # action: + # name: inflate error + # inflation variable: + # name: ObsErrorFactorDuplicateCheck/windNorthward + # There is no across-the-board inflation for nvqc=.true. for scatwinds, presumably because for + # this inflation to take place both nvqc must be .true. AND ibeta must be >0, see: + # https://github.com/NOAA-EMC/GSI/blob/14ae595af1b03471287d322596d35c0665336e95/src/gsi/setupw.f90#L1229 + # GSI settings must have ibeta>0 for satwinds, but not for scatwinds. + # + # If the ibeta settings for scatwinds were to change while nvqc remained .true., we would extend YAML to + # an additional filter that inflates final ob-errors across-the-board by 1/0.8 = 1.25. NOTE: the nvqc setting + # is defaulted to .false. in GSI code, but is overridden in global operational configuration. See: + # configuration, see: https://github.com/NOAA-EMC/global-workflow/blob/d5ae3328fa4041b177357b1133f6b92e81c859d7/scripts/exglobal_atmos_analysis.sh#L750 + # This setting activates Line 1229 of setupw.f90 to scale ratio_errors by 0.8, which is applied in + # the denominator of the final ob-error, so 1/0.8 = 1.25 factor of ob-error inflation. + # + # If this functionality were to be activated for scatwinds, you would want to include this last inflation filter. + #- filter: Perform Action + # filter variables: + # - name: windEastward + # where: + # - variable: ObsType/windEastward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + #- filter: Perform Action + # filter variables: + # - name: windNorthward + # where: + # - variable: ObsType/windNorthward + # is_in: 290-291 + # action: + # name: inflate error + # inflation factor: 1.25 + # END OF FILTERS# + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_omi_aura.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_omi_aura.yaml.j2 new file mode 100644 index 000000000..d9bed021d --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_omi_aura.yaml.j2 @@ -0,0 +1,135 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneTotal] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [1] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: true + stretchVertices: topbottom #options: top, bottom, topbottom, none + model units coeff: 2.241398632746E-3 + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + - filter: Perform Action + filter variables: + - name: ozoneTotal + action: + name: assign error + error parameter: 6.0 + + # Observation Prior Filters (QC) + # ------------------------------ + # GSI read routine QC + # range sanity check + - filter: Bounds Check + filter variables: + - name: ozoneTotal + minvalue: 0 + maxvalue: 10000 + action: + name: reject + + # Do not use the data if row anomaly (bit 10)is 1 + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/totalOzoneQualityFlag + any_bit_set_of: 9 + action: + name: reject + + # Scan position check: reject scan position >= 25 + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + minvalue: 25 + action: + name: reject + + # Accept total_ozone_error_flag values of 0 and 1, but not any others. + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/totalOzoneQualityCode + is_not_in: 0, 1 + action: + name: reject + + # Use data with best ozone algorighm + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/bestOzoneAlgorithmFlag + is_in: 3, 13 + action: + name: reject + + # Data Thinning + - filter: Gaussian Thinning + horizontal_mesh: 150 + use_reduced_horizontal_grid: true + distance_norm: geodesic + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # GSI setup routine QC + # Gross check + - filter: Background Check + filter variables: + - name: ozoneTotal + threshold: 10.0 + absolute threshold: 300.0 + action: + name: reject + + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompsnp_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompsnp_n20.yaml.j2 new file mode 100644 index 000000000..ddba90cbb --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompsnp_n20.yaml.j2 @@ -0,0 +1,333 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: ["latitude"] + sort variable: "pressure" + sort order: "ascending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneLayer] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [22] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: false + stretchVertices: none #options: top, bottom, topbottom, none + # model units coeff: 2.240013904035E-3 # this number to match the gsihofx values + model units coeff: 2.241398632746E-3 # this number to match the gsihofx values (use this) + # the actual scientific conversion factor is + # 2.1415E-3 kg[O3]/m-2 to DU + # so the name of the geovals + # is also likely wrong, as it apprears to be a mass + # fraction given the conversion factor needed + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Observation error assignment + - filter: Perform Action + filter variables: + - name: ozoneLayer + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [0.001, 10.1325, 16.00935, 25.43258, 40.32735, 63.93607, 101.325, + 160.0935, 254.3257, 403.2735, 639.3608, 1013.25, 1600.935, 2543.258, 4032.735, + 6393.607, 10132.5, 16009.35, 25432.57, 40327.35, 63936.07, 101325] + # errors: [7.7236, 0.020, 0.020, 0.025, 0.080, 0.150, 0.056, 0.125, 0.200, + # 0.299, 0.587, 0.864, 1.547, 2.718, 3.893, 4.353, 3.971, 4.407, 4.428, + # 3.312, 2.198, 2.285] + errors: [7.7236, 0.020, 0.020, 0.025, 0.040, 0.080, 0.156, 0.245, 0.510, + 1.098, 3.917, 6.124, 6.347, 5.798, 6.843, 9.253,10.091,10.967, 8.478, + 5.572, 2.638, 3.525] # operational from gfs.v16.3.9 (late 2023) + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Do not assimilation where pressure is zero + # Zero pressure indicates the data is total column ozone + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/pressure + maxvalue: 0.0001 + + # Sanity check on observaton values + - filter: Bounds Check + filter variables: + - name: ozoneLayer + minvalue: 0 + maxvalue: 1000 + action: + name: reject + + # Total Ozone Quality Check (keeps 0, 2) + # 0 indentifies good data + # 2 identifies good data with a solar zenith angle > 84 degrees + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/totalOzoneQuality + is_not_in: 0, 2 + + # Profile Ozone Quality Check (keeps 0, 1, 7) + # 0 : good data + # 1 : good data with a solar zenith angle > 84 degrees + # 7 : profile for which stray light correction applied + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/profileOzoneQuality + is_not_in: 0, 1, 7 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Gross error check + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 120 + action: + name: reject + where: + - variable: + name: MetaData/pressure + maxvalue: 0.001 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 30 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 30000.0 + maxvalue: 110000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 40 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 20000.0 + maxvalue: 30000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 44.42 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 10100.0 + maxvalue: 20000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 57.52 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 6400.0 + maxvalue: 10100.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 69.4 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 4000.0 + maxvalue: 6400.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 70 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 2600.0 + maxvalue: 4000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 62.73 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 1600.0 + maxvalue: 2600.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 50.52 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 1100.0 + maxvalue: 1600.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 35.9 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 700.0 + maxvalue: 1100.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 26.41 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 400.0 + maxvalue: 700.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 20.51 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 300.0 + maxvalue: 400.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 12.82 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 200.0 + maxvalue: 300.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 10 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 70.0 + maxvalue: 200.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 5 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 40.0 + maxvalue: 70.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 2 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 30.0 + maxvalue: 40.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 1 + action: + name: reject + where: + - variable: + name: MetaData/pressure + maxvalue: 30.0 + + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompsnp_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompsnp_npp.yaml.j2 new file mode 100644 index 000000000..ddba90cbb --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompsnp_npp.yaml.j2 @@ -0,0 +1,333 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: ["latitude"] + sort variable: "pressure" + sort order: "ascending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneLayer] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [22] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: false + stretchVertices: none #options: top, bottom, topbottom, none + # model units coeff: 2.240013904035E-3 # this number to match the gsihofx values + model units coeff: 2.241398632746E-3 # this number to match the gsihofx values (use this) + # the actual scientific conversion factor is + # 2.1415E-3 kg[O3]/m-2 to DU + # so the name of the geovals + # is also likely wrong, as it apprears to be a mass + # fraction given the conversion factor needed + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # Observation error assignment + - filter: Perform Action + filter variables: + - name: ozoneLayer + action: + name: assign error + error function: + name: ObsFunction/ObsErrorModelStepwiseLinear + options: + xvar: + name: MetaData/pressure + xvals: [0.001, 10.1325, 16.00935, 25.43258, 40.32735, 63.93607, 101.325, + 160.0935, 254.3257, 403.2735, 639.3608, 1013.25, 1600.935, 2543.258, 4032.735, + 6393.607, 10132.5, 16009.35, 25432.57, 40327.35, 63936.07, 101325] + # errors: [7.7236, 0.020, 0.020, 0.025, 0.080, 0.150, 0.056, 0.125, 0.200, + # 0.299, 0.587, 0.864, 1.547, 2.718, 3.893, 4.353, 3.971, 4.407, 4.428, + # 3.312, 2.198, 2.285] + errors: [7.7236, 0.020, 0.020, 0.025, 0.040, 0.080, 0.156, 0.245, 0.510, + 1.098, 3.917, 6.124, 6.347, 5.798, 6.843, 9.253,10.091,10.967, 8.478, + 5.572, 2.638, 3.525] # operational from gfs.v16.3.9 (late 2023) + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Do not assimilation where pressure is zero + # Zero pressure indicates the data is total column ozone + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/pressure + maxvalue: 0.0001 + + # Sanity check on observaton values + - filter: Bounds Check + filter variables: + - name: ozoneLayer + minvalue: 0 + maxvalue: 1000 + action: + name: reject + + # Total Ozone Quality Check (keeps 0, 2) + # 0 indentifies good data + # 2 identifies good data with a solar zenith angle > 84 degrees + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/totalOzoneQuality + is_not_in: 0, 2 + + # Profile Ozone Quality Check (keeps 0, 1, 7) + # 0 : good data + # 1 : good data with a solar zenith angle > 84 degrees + # 7 : profile for which stray light correction applied + - filter: RejectList + filter variables: + - name: ozoneLayer + where: + - variable: + name: MetaData/profileOzoneQuality + is_not_in: 0, 1, 7 + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + # Gross error check + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 120 + action: + name: reject + where: + - variable: + name: MetaData/pressure + maxvalue: 0.001 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 30 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 30000.0 + maxvalue: 110000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 40 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 20000.0 + maxvalue: 30000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 44.42 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 10100.0 + maxvalue: 20000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 57.52 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 6400.0 + maxvalue: 10100.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 69.4 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 4000.0 + maxvalue: 6400.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 70 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 2600.0 + maxvalue: 4000.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 62.73 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 1600.0 + maxvalue: 2600.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 50.52 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 1100.0 + maxvalue: 1600.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 35.9 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 700.0 + maxvalue: 1100.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 26.41 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 400.0 + maxvalue: 700.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 20.51 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 300.0 + maxvalue: 400.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 12.82 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 200.0 + maxvalue: 300.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 10 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 70.0 + maxvalue: 200.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 5 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 40.0 + maxvalue: 70.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 2 + action: + name: reject + where: + - variable: + name: MetaData/pressure + minvalue: 30.0 + maxvalue: 40.0 + + - filter: Background Check + filter variables: + - name: ozoneLayer + absolute threshold: 1 + action: + name: reject + where: + - variable: + name: MetaData/pressure + maxvalue: 30.0 + + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompstc_n20.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompstc_n20.yaml.j2 new file mode 100644 index 000000000..ac791421c --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompstc_n20.yaml.j2 @@ -0,0 +1,134 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneTotal] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [1] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: true + stretchVertices: topbottom # options: top, bottom, topbottom, none + model units coeff: 2.241398632746E-3 + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # assign observation error + - filter: Perform Action + filter variables: + - name: ozoneTotal + action: + name: assign error + error parameter: 6.0 + + # GSI read routine QC + # range sanity check + - filter: Bounds Check + filter variables: + - name: ozoneTotal + minvalue: 0 + maxvalue: 1000 + action: + name: reject + + #- filter: Gaussian Thinning + # horizontal_mesh: 150 + # use_reduced_horizontal_grid: true + # distance_norm: geodesic + # action: + # name: reject + + # Accept total_ozone_error_flag values of 0 and 1, but not any others. + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/totalOzoneQualityCode + is_not_in: 0, 1 + + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/bestOzoneAlgorithmFlag + is_in: 3, 13 + + # GSI setup routine QC + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 1, 2, 3, 4, 35 + - variable: + name: MetaData/latitude + minvalue: 50.0 + + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 1, 2, 3, 4, 35 + - variable: + name: MetaData/latitude + maxvalue: -50.0 + + - filter: Gaussian Thinning + horizontal_mesh: 150 + use_reduced_horizontal_grid: true + distance_norm: geodesic + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + - filter: Background Check + filter variables: + - name: ozoneTotal + threshold: 10.0 + absolute threshold: 300.0 + action: + name: reject + + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompstc_npp.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompstc_npp.yaml.j2 new file mode 100644 index 000000000..ac791421c --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/retrieval_ozone_ompstc_npp.yaml.j2 @@ -0,0 +1,134 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [ozoneTotal] + + #obs operator: + # name: AtmVertInterpLay + # geovals: [mole_fraction_of_ozone_in_air] + # coefficients: [0.007886131] # convert from ppmv to DU + # nlevels: [1] + + # Observation Operator + # -------------------- + obs operator: + name: ColumnRetrieval + nlayers_retrieval: 1 + tracer variables: [mole_fraction_of_ozone_in_air] + isApriori: false + isAveragingKernel: false + totalNoVertice: true + stretchVertices: topbottom # options: top, bottom, topbottom, none + model units coeff: 2.241398632746E-3 + + # Observation Pre Filters (QC) + # ---------------------------- + obs pre filters: + # assign observation error + - filter: Perform Action + filter variables: + - name: ozoneTotal + action: + name: assign error + error parameter: 6.0 + + # GSI read routine QC + # range sanity check + - filter: Bounds Check + filter variables: + - name: ozoneTotal + minvalue: 0 + maxvalue: 1000 + action: + name: reject + + #- filter: Gaussian Thinning + # horizontal_mesh: 150 + # use_reduced_horizontal_grid: true + # distance_norm: geodesic + # action: + # name: reject + + # Accept total_ozone_error_flag values of 0 and 1, but not any others. + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/totalOzoneQualityCode + is_not_in: 0, 1 + + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/bestOzoneAlgorithmFlag + is_in: 3, 13 + + # GSI setup routine QC + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 1, 2, 3, 4, 35 + - variable: + name: MetaData/latitude + minvalue: 50.0 + + - filter: RejectList + filter variables: + - name: ozoneTotal + where: + - variable: + name: MetaData/sensorScanPosition + is_in: 1, 2, 3, 4, 35 + - variable: + name: MetaData/latitude + maxvalue: -50.0 + + - filter: Gaussian Thinning + horizontal_mesh: 150 + use_reduced_horizontal_grid: true + distance_norm: geodesic + action: + name: reduce obs space + + # Observation Post Filters (QC) + # ----------------------------- + obs post filters: + - filter: Background Check + filter variables: + - name: ozoneTotal + threshold: 10.0 + absolute threshold: 300.0 + action: + name: reject + + # End of Filters + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/satwind.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/satwind.yaml.j2 new file mode 100644 index 000000000..de5580710 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/satwind.yaml.j2 @@ -0,0 +1,46 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: satwind + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [windEastward, windNorthward] + + # Observation Operator + # -------------------- + obs operator: + name: VertInterp + hofx scaling field: SurfaceWindScalingPressure + hofx scaling field group: DerivedVariables + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: VertInterp + + # Observation Prior Filters (QC) + # ------------------------------ + obs prior filters: + # Apply variable changes needed for wind scaling + # For wind observations with pressure provided + - filter: Variable Transforms + Transform: SurfaceWindScalingPressure + SkipWhenNoObs: false + + - filter: PreQC + maxvalue: 0.0 + minvalue: 0.0 + inputQC: GsiEffectiveQCGes + action: + name: reject \ No newline at end of file diff --git a/parm/jcb-gdas/observations/atmosphere/sfc.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/sfc.yaml.j2 new file mode 100644 index 000000000..71ab0308d --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/sfc.yaml.j2 @@ -0,0 +1,44 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure] + + # Observation Operator + # -------------------- + obs operator: + name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + station_altitude: height + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/sfcship.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/sfcship.yaml.j2 new file mode 100644 index 000000000..c0bc9e8c7 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/sfcship.yaml.j2 @@ -0,0 +1,101 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + overwrite: true + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure, airTemperature, specificHumidity] + + # Observation Operator + # -------------------- + obs operator: + name: Composite + components: + - name: VertInterp + variables: + - name: airTemperature + - name: specificHumidity + - name: SfcCorrected + variables: + - name: stationPressure + correction scheme to use: GSL + geovar_sfc_geomz: height_above_mean_sea_level_at_surface + geovar_geomz: geopotential_height + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Identity + + # Observation Filters (QC) + # ------------------------ + obs filters: + # Observation range sanity check + - filter: Bounds Check + filter variables: + - name: stationPressure + minvalue: 37499.0 + maxvalue: 106999.0 + action: + name: reject + - filter: Bounds Check + filter variables: + - name: airTemperature + minvalue: 195.0 + maxvalue: 327.0 + action: + name: reject + - filter: Bounds Check + filter variables: + - name: specificHumidity + minvalue: 0.0 + maxvalue: 0.03499 + action: + name: reject + + # Gross error check with (O - B) / ObsError greater than threshold. + - filter: Background Check + filter variables: + - name: stationPressure + threshold: 3.6 + absolute threshold: 990.0 + action: + name: reject + defer to post: true + - filter: Background Check + filter variables: + - name: airTemperature + threshold: 7.0 + absolute threshold: 9.0 + action: + name: reject + defer to post: true + + # Reject all ObsType 183 + - filter: BlackList + where: + - variable: + name: ObsType/stationPressure + is_in: 183 + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/atmosphere/sondes.yaml.j2 b/parm/jcb-gdas/observations/atmosphere/sondes.yaml.j2 new file mode 100644 index 000000000..62cc621b8 --- /dev/null +++ b/parm/jcb-gdas/observations/atmosphere/sondes.yaml.j2 @@ -0,0 +1,131 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}{{atmosphere_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: ["stationIdentification"] + sort variable: "pressure" + sort order: "descending" + obsdataout: + engine: + type: H5File + obsfile: "{{atmosphere_obsdataout_path}}/{{atmosphere_obsdataout_prefix}}{{observation_from_jcb}}{{atmosphere_obsdataout_suffix}}" + io pool: + max pool size: 1 + simulated variables: [stationPressure, airTemperature, virtualTemperature, windEastward, windNorthward, + specificHumidity] + + # Observation Operator + # -------------------- + obs operator: + name: Composite + components: + - name: VertInterp + variables: + - name: airTemperature + - name: virtualTemperature + - name: windEastward + - name: windNorthward + - name: specificHumidity + - name: SfcCorrected + correction scheme to use: GSL + geovar_sfc_geomz: geopotential_height_at_surface + geovar_geomz: geopotential_height + variables: + - name: stationPressure + + # Linear Observation Operator + # --------------------------- + linear obs operator: + name: Composite + components: + - name: VertInterp + variables: + - name: airTemperature + - name: virtualTemperature + - name: windEastward + - name: windNorthward + - name: specificHumidity + - name: Identity + variables: + - name: stationPressure + + # Observation Filters (QC) + # ------------------------ + obs filters: + # + # Reject all obs with PreQC mark already set above 3 + - filter: PreQC + maxvalue: 3.0 + action: + name: reject + # + # Observation Range Sanity Check + - filter: Bounds Check + filter variables: + - name: stationPressure + minvalue: 37499.0 + maxvalue: 106999.0 + action: + name: reject + # + # Assign obsError + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: assign error + error parameter: 100.0 # 1.0 hPa + # + # Assign the initial observation error, based on height/pressure + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: assign error + error function: + name: ObsErrorModelStepwiseLinear@ObsFunction + options: + xvar: + name: ObsValue/stationPressure + xvals: [80000.0, 75000.0] + errors: [110.0, 120.0] # 1.1 mb below 800 mb and 1.2 mb agove 750 mb + # + - filter: Perform Action + filter variables: + - name: stationPressure + action: + name: inflate error + inflation variable: + name: ObsErrorFactorSfcPressure@ObsFunction + options: + error_min: 100.0 # 1 mb + error_max: 300.0 # 3 mb + geovar_geomz: geopotential_height + geovar_sfc_geomz: geopotential_height_at_surface + # + # Gross error check with (O - B) / ObsError greater than threshold + - filter: Background Check + filter variables: + - name: stationPressure + threshold: 3.6 + absolute threshold: 990.0 + action: + name: reject + + + # GeoVaLs for Driving Observation Operators (testing mode) + # -------------------------------------------------------- + geovals: + filename: "{{atmosphere_obsdatain_path}}/{{atmosphere_obsdatain_prefix}}{{observation_from_jcb}}_geoval{{atmosphere_obsdatain_suffix}}" + + # Passed benchmark for UFO testing + # -------------------------------- + passedBenchmark: 0 diff --git a/parm/jcb-gdas/observations/marine/adt_rads_all.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_all.yaml.j2 new file mode 100644 index 000000000..a82f710d2 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_all.yaml.j2 @@ -0,0 +1,78 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [absoluteDynamicTopography] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: ADT + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + minvalue: 5.0 + - filter: Background Check + absolute threshold: 1.0 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_floor_depth_below_sea_surface} + minvalue: 500 + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: [GeoVaLs/mesoscale_representation_error, + ObsError/absoluteDynamicTopography] + coefs: [0.2, + 3.0] + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_ice_area_fraction} + maxvalue: 0.00001 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 50e3 + - filter: BlackList + where: + - variable: + name: MetaData/latitude + minvalue: 4 + maxvalue: 30 + - variable: + name: MetaData/longitude + minvalue: 32 + maxvalue: 56 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/adt_rads_cryosat2.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_cryosat2.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_cryosat2.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/adt_rads_jason3.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_jason3.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_jason3.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/adt_rads_saral.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_saral.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_saral.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/adt_rads_sentinel3a.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_sentinel3a.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_sentinel3a.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/adt_rads_sentinel3b.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_sentinel3b.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_sentinel3b.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/adt_rads_sentinel6a.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_sentinel6a.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_sentinel6a.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/adt_rads_swot.yaml.j2 b/parm/jcb-gdas/observations/marine/adt_rads_swot.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/adt_rads_swot.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_abi_g16_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_abi_g16_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_abi_g16_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_amsr2_north.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_amsr2_north.yaml.j2 new file mode 100644 index 000000000..5696bdc66 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_amsr2_north.yaml.j2 @@ -0,0 +1,65 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaIceFraction] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Bounds Check + minvalue: 0.0 + maxvalue: 1.0 + - filter: Background Check + absolute threshold: 0.5 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 2.0 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 0.0 + action: + name: inflate error + inflation factor: 2.0 +{% if marine_letkf_app | default(false) %} + - filter: Gaussian Thinning + horizontal_mesh: 25 #km + use_reduced_horizontal_grid: true + select_median: true + action: + name: reduce obs space +{% endif %} +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/icec_amsr2_south.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_amsr2_south.yaml.j2 new file mode 100644 index 000000000..5696bdc66 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_amsr2_south.yaml.j2 @@ -0,0 +1,65 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaIceFraction] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Bounds Check + minvalue: 0.0 + maxvalue: 1.0 + - filter: Background Check + absolute threshold: 0.5 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 2.0 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 0.0 + action: + name: inflate error + inflation factor: 2.0 +{% if marine_letkf_app | default(false) %} + - filter: Gaussian Thinning + horizontal_mesh: 25 #km + use_reduced_horizontal_grid: true + select_median: true + action: + name: reduce obs space +{% endif %} +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/icec_amsu_ma1_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_amsu_ma1_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_amsu_ma1_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_amsu_mb_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_amsu_mb_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_amsu_mb_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_atms_n20_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_atms_n20_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_atms_n20_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_atms_n21_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_atms_n21_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_atms_n21_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_atms_npp_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_atms_npp_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_atms_npp_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_generic_passive.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_generic_passive.yaml.j2 new file mode 100644 index 000000000..8526710ae --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_generic_passive.yaml.j2 @@ -0,0 +1,73 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaIceFraction] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Bounds Check + minvalue: 0.0 + maxvalue: 1.0 + #- filter: Background Check + # threshold: 5.0 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 2.0 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 0.0 + action: + name: inflate error + inflation factor: 2.0 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 0e3 + - filter: Gaussian Thinning + horizontal_mesh: 25 #km + use_reduced_horizontal_grid: true + select_median: true + action: + name: reduce obs space + - filter: Domain Check + action: + name: passivate + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + maxvalue: -4.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/icec_gmi_gpm_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_gmi_gpm_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_gmi_gpm_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_ssmis_f17_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_ssmis_f17_l2.yaml.j2 new file mode 100644 index 000000000..ac83a5e80 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_ssmis_f17_l2.yaml.j2 @@ -0,0 +1,73 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaIceFraction] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Bounds Check + minvalue: 0.0 + maxvalue: 1.0 + #- filter: Background Check + # threshold: 5.0 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 2.0 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_surface_temperature} + maxvalue: 0.0 + action: + name: inflate error + inflation factor: 2.0 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 0e3 + - filter: Gaussian Thinning + horizontal_mesh: 25 #km + use_reduced_horizontal_grid: true + select_median: true + action: + name: reduce obs space +# - filter: Domain Check +# action: +# name: passivate +# where: +# - variable: {name: GeoVaLs/sea_surface_temperature} +# maxvalue: -4.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/icec_viirs_j01_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_viirs_j01_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_viirs_j01_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_viirs_n20_l2_north.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_viirs_n20_l2_north.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_viirs_n20_l2_north.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_viirs_n20_l2_south.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_viirs_n20_l2_south.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_viirs_n20_l2_south.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_viirs_n21_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_viirs_n21_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_viirs_n21_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/icec_viirs_npp_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/icec_viirs_npp_l2.yaml.j2 new file mode 120000 index 000000000..3ebe0973c --- /dev/null +++ b/parm/jcb-gdas/observations/marine/icec_viirs_npp_l2.yaml.j2 @@ -0,0 +1 @@ +icec_generic_passive.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_bathy.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_bathy.yaml.j2 new file mode 100644 index 000000000..fe8bea759 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_bathy.yaml.j2 @@ -0,0 +1,44 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: InsituTemperature + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_glider.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_glider.yaml.j2 new file mode 100644 index 000000000..513af6ccf --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_glider.yaml.j2 @@ -0,0 +1,48 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Composite + components: + - name: InsituTemperature + variables: + - name: waterTemperature + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_marinemammal.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_marinemammal.yaml.j2 new file mode 100644 index 000000000..513af6ccf --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_marinemammal.yaml.j2 @@ -0,0 +1,48 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Composite + components: + - name: InsituTemperature + variables: + - name: waterTemperature + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_tesac.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_tesac.yaml.j2 new file mode 100644 index 000000000..9eb69b6b4 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_tesac.yaml.j2 @@ -0,0 +1,46 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Composite + components: + - name: InsituTemperature + variables: + - name: waterTemperature + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_tesac_salinity.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_tesac_salinity.yaml.j2 new file mode 100644 index 000000000..6a0fe7553 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_tesac_salinity.yaml.j2 @@ -0,0 +1,48 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [salinity] + observed variables: [salinity] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: VertInterp + observation alias file: ./obsop_name_map.yaml + vertical coordinate: sea_water_depth + observation vertical coordinate: depth + interpolation method: linear + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/salinity + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_tropical.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_tropical.yaml.j2 new file mode 100644 index 000000000..83c5788b2 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_tropical.yaml.j2 @@ -0,0 +1,54 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Composite + components: + - name: InsituTemperature + variables: + - name: waterTemperature + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 100.0 + - filter: Domain Check + action: + name: passivate + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + maxvalue: -4.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_profile_xbtctd.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_profile_xbtctd.yaml.j2 new file mode 100644 index 000000000..513af6ccf --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_profile_xbtctd.yaml.j2 @@ -0,0 +1,48 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Composite + components: + - name: InsituTemperature + variables: + - name: waterTemperature + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_salt_profile_argo.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_salt_profile_argo.yaml.j2 new file mode 100644 index 000000000..c11b62483 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_salt_profile_argo.yaml.j2 @@ -0,0 +1,202 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [latitude, longitude, dateTime] + sort variable: depth + sort group: MetaData + sort order: ascending + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [salinity] + observed variables: [salinity] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: VertInterp + observation alias file: ./obsop_name_map.yaml + vertical coordinate: sea_water_depth + observation vertical coordinate: depth + interpolation method: linear + obs error: + covariance model: diagonal + + #------------------------------------------------------------------------------- + # START OF OBS FILTERS (work done by Kriti Bhargava) + # The QC filters used here are based on the document by IODE that can be found at + # https://cdn.ioos.noaa.gov/media/2017/12/recommendations_in_situ_data_real_time_qc.pdf + #------------------------------------------------------------------------------- + + obs filters: + + # land check + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.5 + + + ## Filters for S: + #------------------------------------------------------------------------------- + #----------------------------------------------------------------------------- + ### Global range test + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 2.0 + maxvalue: 41.0 + + #----------------------------------------------------------------------------- + ### Regional range test + #----------------------------------------------------------------------------- + #### Red Sea + #----------------------------------------------------------------------------- + #### + #### the document linked here describes Red sea as the are between 10N, 40E; + #### 20N, 50E; 30N, 30E; 10N, 40E. But that would also include Gulf of Aden. + #### A more reasonable choice seemed to be a box that extends from 10 N to + #### 30 N and 30 E to 45 East . + + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 2.0 + maxvalue: 41.0 + where: + - variable: + name: MetaData/latitude + minvalue: 10 + maxvalue: 30 + - variable: + name: MetaData/longitude + minvalue: 30 + maxvalue: 45 + + #### Mediterranean Sea + #----------------------------------------------------------------------------- + ##### Area 1/3 for Mediterranean Sea + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 2.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 30 + maxvalue: 40 + - variable: + name: MetaData/longitude + minvalue: -6 + maxvalue: 40 + ##### Area 2/3 for Mediterranean Sea + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 2.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 40 + maxvalue: 41.5 + - variable: + name: MetaData/longitude + minvalue: 20 + maxvalue: 30 + ##### Area 3/3 for Mediterranean Sea + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 2.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 40 + maxvalue: 46 + - variable: + name: MetaData/longitude + minvalue: 0 + maxvalue: 20 + + + #### Northwestern shelves + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 0.0 + maxvalue: 37.0 + where: + - variable: + name: MetaData/latitude + minvalue: 50 + maxvalue: 60 + - variable: + name: MetaData/longitude + minvalue: -20 + maxvalue: 10 + + #### Southwestern shelves + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 0.0 + maxvalue: 38 + where: + - variable: + name: MetaData/latitude + minvalue: 25 + maxvalue: 50 + - variable: + name: MetaData/longitude + minvalue: -30 + maxvalue: 0 + + #### Arctic Ocean + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: salinity}] + minvalue: 2.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 60 + + - filter: Background Check + filter variables: [{name: salinity}] + threshold: 5.0 + absolute threshold: 5.0 + + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/salinity + coefs: + - 100.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_surface_altkob.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_surface_altkob.yaml.j2 new file mode 100644 index 000000000..aadad95f3 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_surface_altkob.yaml.j2 @@ -0,0 +1,45 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceTemperature] + observed variables: [seaSurfaceTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/seaSurfaceTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_surface_dbuoyb_drifter.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_surface_dbuoyb_drifter.yaml.j2 new file mode 100644 index 000000000..b99ea1d04 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_surface_dbuoyb_drifter.yaml.j2 @@ -0,0 +1,61 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceTemperature] + observed variables: [seaSurfaceTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + + obs pre filters: + - filter: Bounds Check + minvalue: -1.2 + maxvalue: 41.0 + - filter: Domain Check + where: + - variable: {name: ObsError/seaSurfaceTemperature} + minvalue: 1.0e-8 + + obs prior filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_ice_area_fraction} + maxvalue: 1.0e-5 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + minvalue: -1.2 + +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_surface_trkob.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_surface_trkob.yaml.j2 new file mode 100644 index 000000000..c4b8e8b51 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_surface_trkob.yaml.j2 @@ -0,0 +1,45 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceTemperature] + observed variables: [seaSurfaceTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: Identity + observation alias file: ./obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/seaSurfaceTemperature + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_surface_trkob_salinity.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_surface_trkob_salinity.yaml.j2 new file mode 100644 index 000000000..97f4c58f2 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_surface_trkob_salinity.yaml.j2 @@ -0,0 +1,45 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceSalinity] + observed variables: [seaSurfaceSalinity] +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: ./obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/seaSurfaceSalinity + coefs: + - 1000.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_temp_profile_argo.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_temp_profile_argo.yaml.j2 new file mode 100644 index 000000000..b2c0572e1 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_temp_profile_argo.yaml.j2 @@ -0,0 +1,198 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsgrouping: + group variables: [latitude, longitude, dateTime] + sort variable: depth + sort group: MetaData + sort order: ascending + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [waterTemperature] + observed variables: [waterTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + obs operator: + name: InsituTemperature + obs error: + covariance model: diagonal + + #------------------------------------------------------------------------------- + # START OF OBS FILTERS (work done by Kriti Bhargava) + # The QC filters used here are based on the document by IODE that can be found at + # https://cdn.ioos.noaa.gov/media/2017/12/recommendations_in_situ_data_real_time_qc.pdf + #------------------------------------------------------------------------------- + + obs filters: + + # land check + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.5 + + #------------------------------------------------------------------------------- + ## Filters for T: + #------------------------------------------------------------------------------- + #------------------------------------------------------------------------------- + ### Global range test + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: -2.5 + maxvalue: 40.0 + + #----------------------------------------------------------------------------- + ### Regional range tests + #----------------------------------------------------------------------------- + + #### Red Sea + #----------------------------------------------------------------------------- + #### + #### the document linked here describes Red sea as the are between 10N, 40E; + #### 20N, 50E; 30N, 30E; 10N, 40E. But that would also include Gulf of Aden. + #### A more reasonable choice seemed to be a box that extends from 10 N to + #### 30 N and 30 E to 45 East . + + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: 21.7 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 10 + maxvalue: 30 + - variable: + name: MetaData/longitude + minvalue: 30 + maxvalue: 45 + + #### Mediterranean Sea + #----------------------------------------------------------------------------- + ##### Area 1/3 for Mediterranean Sea + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: 10.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 30 + maxvalue: 40 + - variable: + name: MetaData/longitude + minvalue: -6 + maxvalue: 40 + ##### Area 2/3 for Mediterranean Sea + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: 10.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 40 + maxvalue: 41.5 + - variable: + name: MetaData/longitude + minvalue: 20 + maxvalue: 30 + ##### Area 3/3 for Mediterranean Sea + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: 10.0 + maxvalue: 40.0 + where: + - variable: + name: MetaData/latitude + minvalue: 40 + maxvalue: 46 + - variable: + name: MetaData/longitude + minvalue: 0 + maxvalue: 20 + + #### Northwestern shelves + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: -2.0 + maxvalue: 24.0 + where: + - variable: + name: MetaData/latitude + minvalue: 50 + maxvalue: 60 + - variable: + name: MetaData/longitude + minvalue: -20 + maxvalue: 10 + + #### Southwestern shelves + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: -2.0 + maxvalue: 30 + where: + - variable: + name: MetaData/latitude + minvalue: 25 + maxvalue: 50 + - variable: + name: MetaData/longitude + minvalue: -30 + maxvalue: 0 + + #### Arctic Ocean + #----------------------------------------------------------------------------- + + - filter: Bounds Check + filter variables: [{name: waterTemperature}] + minvalue: -1.92 + maxvalue: 25.0 + where: + - variable: + name: MetaData/latitude + minvalue: 60 + +# - filter: Background Check +# filter variables: [{name: waterTemperature}] +# threshold: 5.0 +# absolute threshold: 5.0 + + - filter: Perform Action + action: + name: assign error + error function: + name: ObsFunction/LinearCombination + options: + variables: + - ObsError/waterTemperature + coefs: + - 100.0 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/insitu_temp_surface_drifter.yaml.j2 b/parm/jcb-gdas/observations/marine/insitu_temp_surface_drifter.yaml.j2 new file mode 100644 index 000000000..648ee2ed8 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/insitu_temp_surface_drifter.yaml.j2 @@ -0,0 +1,65 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceTemperature] + observed variables: [seaSurfaceTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + + obs pre filters: + - filter: Bounds Check + minvalue: -1.2 + maxvalue: 41.0 + - filter: Domain Check + where: + - variable: {name: ObsError/seaSurfaceTemperature} + minvalue: 1.0e-8 + + obs prior filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_ice_area_fraction} + maxvalue: 1.0e-5 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + minvalue: -1.2 + + obs post filters: + - filter: Background Check + absolute threshold: 5.0 + +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/rads_adt_3a.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_3a.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_3a.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_3b.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_3b.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_3b.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_6a.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_6a.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_6a.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_c2.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_c2.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_c2.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_j2.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_j2.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_j2.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_j3.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_j3.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_j3.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_sa.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_sa.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_sa.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/rads_adt_sw.yaml.j2 b/parm/jcb-gdas/observations/marine/rads_adt_sw.yaml.j2 new file mode 120000 index 000000000..02ad0a9d7 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/rads_adt_sw.yaml.j2 @@ -0,0 +1 @@ +adt_rads_all.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sss_smap_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/sss_smap_l2.yaml.j2 new file mode 100644 index 000000000..a075b5545 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sss_smap_l2.yaml.j2 @@ -0,0 +1,60 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceSalinity] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Bounds Check + minvalue: 0.1 + maxvalue: 40.0 + - filter: Background Check + threshold: 5.0 + - filter: Domain Check + action: + name: passivate + where: + - variable: {name: GeoVaLs/sea_surface_temperature} +# minvalue: 15.0 + maxvalue: -4.0 + ## Gaussian_Thinning is having problems with LETKF, try again later + # - filter: Gaussian_Thinning + # horizontal_mesh: 25.0 #km + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 100e3 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/sss_smos_l2.yaml.j2 b/parm/jcb-gdas/observations/marine/sss_smos_l2.yaml.j2 new file mode 100644 index 000000000..a075b5545 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sss_smos_l2.yaml.j2 @@ -0,0 +1,60 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceSalinity] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + obs filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Bounds Check + minvalue: 0.1 + maxvalue: 40.0 + - filter: Background Check + threshold: 5.0 + - filter: Domain Check + action: + name: passivate + where: + - variable: {name: GeoVaLs/sea_surface_temperature} +# minvalue: 15.0 + maxvalue: -4.0 + ## Gaussian_Thinning is having problems with LETKF, try again later + # - filter: Gaussian_Thinning + # horizontal_mesh: 25.0 #km + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 100e3 +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/sst_abi_g16_l3c.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_abi_g16_l3c.yaml.j2 new file mode 120000 index 000000000..b3649a670 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_abi_g16_l3c.yaml.j2 @@ -0,0 +1 @@ +sst_generic_geo.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_abi_g17_l3c.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_abi_g17_l3c.yaml.j2 new file mode 120000 index 000000000..b3649a670 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_abi_g17_l3c.yaml.j2 @@ -0,0 +1 @@ +sst_generic_geo.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_ahi_h08_l3c.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_ahi_h08_l3c.yaml.j2 new file mode 120000 index 000000000..b3649a670 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_ahi_h08_l3c.yaml.j2 @@ -0,0 +1 @@ +sst_generic_geo.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_avhrr_ma_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_avhrr_ma_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_avhrr_ma_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_avhrr_mb_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_avhrr_mb_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_avhrr_mb_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_avhrr_mc_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_avhrr_mc_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_avhrr_mc_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_avhrrf_ma_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_avhrrf_ma_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_avhrrf_ma_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_avhrrf_mb_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_avhrrf_mb_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_avhrrf_mb_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_avhrrf_mc_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_avhrrf_mc_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_avhrrf_mc_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_generic.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_generic.yaml.j2 new file mode 100644 index 000000000..d887bf220 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_generic.yaml.j2 @@ -0,0 +1,78 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + + obs prior filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 50e3 + - filter: Perform Action # accept obs that failed previous QC in Pamlico Sound & Chesapeake Bay + action: + name: accept + where: + - variable: + name: MetaData/latitude + minvalue: 34.5 + maxvalue: 39.7 + - variable: + name: MetaData/longitude + minvalue: -76.88 + maxvalue: -74.5 + - filter: Bounds Check + minvalue: -1.2 + maxvalue: 41.0 + - filter: Domain Check + where: + - variable: {name: ObsError/seaSurfaceTemperature} + minvalue: 1.0e-8 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_ice_area_fraction} + maxvalue: 1.0e-5 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + minvalue: -1.2 + + obs post filters: + - filter: Background Check + absolute threshold: 5.0 + +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/sst_generic_geo.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_generic_geo.yaml.j2 new file mode 100644 index 000000000..ffe625a4e --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_generic_geo.yaml.j2 @@ -0,0 +1,84 @@ +- obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{marine_obsdatain_path}}/{{marine_obsdatain_prefix}}{{observation_from_jcb}}{{marine_obsdatain_suffix}}" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{marine_obsdataout_path}}/{{marine_obsdataout_prefix}}{{observation_from_jcb}}{{marine_obsdataout_suffix}}" + simulated variables: [seaSurfaceTemperature] + io pool: + max pool size: 1 +{% if marine_letkf_app | default(false) %} + distribution: + name: Halo + halo size: {{ marine_letkf_dist_halo_size }} +{% endif %} + get values: + time interpolation: linear + obs operator: + name: Identity + observation alias file: obsop_name_map.yaml + obs error: + covariance model: diagonal + + obs prior filters: + - filter: Domain Check + where: + - variable: {name: GeoVaLs/distance_from_coast} + minvalue: 50e3 + - filter: Perform Action # accept obs that failed previous QC in Pamlico Sound & Chesapeake Bay + action: + name: accept + where: + - variable: + name: MetaData/latitude + minvalue: 34.5 + maxvalue: 39.7 + - variable: + name: MetaData/longitude + minvalue: -76.88 + maxvalue: -74.5 + - filter: Bounds Check + minvalue: -1.2 + maxvalue: 41.0 + - filter: Domain Check + where: + - variable: {name: ObsError/seaSurfaceTemperature} + minvalue: 1.0e-8 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_area_fraction} + value: is_valid + minvalue: 0.9 + - filter: Domain Check + where: + - variable: { name: GeoVaLs/sea_ice_area_fraction} + maxvalue: 1.0e-5 + - filter: Domain Check + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + minvalue: -1.2 + - filter: Domain Check + action: + name: passivate + where: + - variable: {name: GeoVaLs/sea_surface_temperature} + maxvalue: -4.0 + + obs post filters: + - filter: Background Check + absolute threshold: 5.0 + +{% if marine_letkf_app | default(false) %} + obs localizations: + - localization method: Rossby + base value: 100.0e3 + rossby mult: 1.0 + min grid mult: 2.0 + min value: 200.0e3 + max value: 900.0e3 +{% endif %} diff --git a/parm/jcb-gdas/observations/marine/sst_viirs_n20_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_viirs_n20_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_viirs_n20_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_viirs_n21_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_viirs_n21_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_viirs_n21_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/marine/sst_viirs_npp_l3u.yaml.j2 b/parm/jcb-gdas/observations/marine/sst_viirs_npp_l3u.yaml.j2 new file mode 120000 index 000000000..5298b9a81 --- /dev/null +++ b/parm/jcb-gdas/observations/marine/sst_viirs_npp_l3u.yaml.j2 @@ -0,0 +1 @@ +sst_generic.yaml.j2 \ No newline at end of file diff --git a/parm/jcb-gdas/observations/snow/adpsfc_snow.yaml.j2 b/parm/jcb-gdas/observations/snow/adpsfc_snow.yaml.j2 new file mode 100644 index 000000000..cd3aa5f8a --- /dev/null +++ b/parm/jcb-gdas/observations/snow/adpsfc_snow.yaml.j2 @@ -0,0 +1,217 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: bufr + obsfile: "{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}{{snow_obsdatain_suffix}}" + mapping file: "{{snow_obsdatain_path}}/bufr_adpsfc_mapping.yaml" + missing file action: warn + obsgrouping: + group variables: [stationIdentification] + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: temporal_thinning + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + - filter: Temporal Thinning + min_spacing: '{{ window_length }}' + seed_time: '{{ snow_background_time_iso }}' + category_variable: + name: MetaData/stationIdentification + actions: + - name: set + flag: temporal_thinning + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/ghcn_snow.yaml.j2 b/parm/jcb-gdas/observations/snow/ghcn_snow.yaml.j2 new file mode 100644 index 000000000..4ad6a7444 --- /dev/null +++ b/parm/jcb-gdas/observations/snow/ghcn_snow.yaml.j2 @@ -0,0 +1,202 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{snow_prepobs_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}.nc" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/ims_snow.yaml.j2 b/parm/jcb-gdas/observations/snow/ims_snow.yaml.j2 new file mode 100644 index 000000000..ef1685c3e --- /dev/null +++ b/parm/jcb-gdas/observations/snow/ims_snow.yaml.j2 @@ -0,0 +1,128 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}.tm00.nc" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: background_check + initial value: false + - name: spatial_thinning + initial value: false + # assign observation error + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 80.0 + + obs prior filters: + # remove land-ice and sea points + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + + obs post filters: + # gross error check + - filter: Background Check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + + # thinning of remaining obs + - filter: Gaussian Thinning + horizontal_mesh: 40.0 # km + actions: + - name: set + flag: spatial_thinning + ignore: rejected observations + - name: reject + + # excludes where both obs & mod = 100% (set in IMS_proc) + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/madis_snow.yaml.j2 b/parm/jcb-gdas/observations/snow/madis_snow.yaml.j2 new file mode 100644 index 000000000..b900fd37b --- /dev/null +++ b/parm/jcb-gdas/observations/snow/madis_snow.yaml.j2 @@ -0,0 +1,216 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}snocvr_snow.nc4" + missing file action: warn + obsgrouping: + group variables: [stationIdentification] + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: temporal_thinning + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + - filter: Temporal Thinning + min_spacing: '{{ window_length }}' + seed_time: '{{ snow_background_time_iso }}' + category_variable: + name: MetaData/stationIdentification + actions: + - name: set + flag: temporal_thinning + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/sfcsno.yaml.j2 b/parm/jcb-gdas/observations/snow/sfcsno.yaml.j2 new file mode 100644 index 000000000..a465cbe3e --- /dev/null +++ b/parm/jcb-gdas/observations/snow/sfcsno.yaml.j2 @@ -0,0 +1,217 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: bufr + obsfile: "{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}{{snow_obsdatain_suffix}}" + mapping file: "{{snow_obsdatain_path}}/bufr_sfcsno_mapping.yaml" + missing file action: warn + obsgrouping: + group variables: [stationIdentification] + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: temporal_thinning + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + - filter: Temporal Thinning + min_spacing: '{{ window_length }}' + seed_time: '{{ snow_background_time_iso }}' + category_variable: + name: MetaData/stationIdentification + actions: + - name: set + flag: temporal_thinning + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/snocvr.yaml.j2 b/parm/jcb-gdas/observations/snow/snocvr.yaml.j2 new file mode 100644 index 000000000..0626a145b --- /dev/null +++ b/parm/jcb-gdas/observations/snow/snocvr.yaml.j2 @@ -0,0 +1,217 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: bufr + obsfile: "{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}{{snow_obsdatain_suffix}}" + mapping file: "{{snow_obsdatain_path}}/bufr_snocvr_mapping.yaml" + missing file action: warn + obsgrouping: + group variables: [stationIdentification] + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: temporal_thinning + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + - filter: Temporal Thinning + min_spacing: '{{ window_length }}' + seed_time: '{{ snow_background_time_iso }}' + category_variable: + name: MetaData/stationIdentification + actions: + - name: set + flag: temporal_thinning + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/snocvr_snomad.yaml.j2 b/parm/jcb-gdas/observations/snow/snocvr_snomad.yaml.j2 new file mode 100644 index 000000000..9d9d64825 --- /dev/null +++ b/parm/jcb-gdas/observations/snow/snocvr_snomad.yaml.j2 @@ -0,0 +1,216 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{snow_prepobs_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}.tm00.nc" + missing file action: warn + obsgrouping: + group variables: [stationIdentification] + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: temporal_thinning + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + - filter: Temporal Thinning + min_spacing: '{{ window_length }}' + seed_time: '{{ snow_background_time_iso }}' + category_variable: + name: MetaData/stationIdentification + actions: + - name: set + flag: temporal_thinning + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/snow/snomad.yaml.j2 b/parm/jcb-gdas/observations/snow/snomad.yaml.j2 new file mode 100644 index 000000000..58a23ac10 --- /dev/null +++ b/parm/jcb-gdas/observations/snow/snomad.yaml.j2 @@ -0,0 +1,217 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: bufr + obsfile: "{{snow_obsdatain_path}}/{{snow_obsdatain_prefix}}{{observation_from_jcb}}{{snow_obsdatain_suffix}}" + mapping file: "{{snow_obsdatain_path}}/bufr_snomad_mapping.yaml" + missing file action: warn + obsgrouping: + group variables: [stationIdentification] + obsdataout: + engine: + type: H5File + obsfile: "{{snow_obsdataout_path}}/{{snow_obsdataout_prefix}}{{observation_from_jcb}}{{snow_obsdataout_suffix}}" + simulated variables: [totalSnowDepth] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_snowdepth + initial value: false + - name: missing_elevation + initial value: false + - name: temporal_thinning + initial value: false + - name: invalid_snowdepth + initial value: false + - name: invalid_elevation + initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: elevation_bkgdiff + initial value: false + - name: rejectlist + initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: totalSnowDepth + action: + name: assign error + error parameter: 40.0 + - filter: Domain Check + where: + - variable: + name: ObsValue/totalSnowDepth + value: is_valid + actions: + - name: set + flag: missing_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + value: is_valid + actions: + - name: set + flag: missing_elevation + ignore: rejected observations + - name: reject + - filter: Temporal Thinning + min_spacing: '{{ window_length }}' + seed_time: '{{ snow_background_time_iso }}' + category_variable: + name: MetaData/stationIdentification + actions: + - name: set + flag: temporal_thinning + ignore: rejected observations + - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: totalSnowDepth + minvalue: 0.0 + maxvalue: 20000.0 + actions: + - name: set + flag: invalid_snowdepth + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject + - filter: Domain Check + where: + - variable: + name: MetaData/stationElevation + minvalue: -200.0 + maxvalue: 3000.0 + actions: + - name: set + flag: invalid_elevation + ignore: rejected observations + - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: Difference Check # elevation check + reference: MetaData/stationElevation + value: GeoVaLs/filtered_orography + threshold: 800. + actions: + - name: set + flag: elevation_bkgdiff + ignore: rejected observations + - name: reject + # Add inflate error characterized by a function of elevation difference + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [MetaData/stationElevation, GeoVaLs/filtered_orography] + coefficients: [1., -1.] + total exponent: 2 + total coefficient: 0.0000015625 #1/(800*800) + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp + type: float + function: + name: ObsFunction/Exponential + options: + variables: [DerivedMetaData/elevation_diff] + coeffA: 1. + coeffB: -1. + coeffC: 0. + coeffD: 1. + - filter: Variable Assignment + assignments: + - name: DerivedMetaData/elevation_diff_exp_inv + type: float + function: + name: ObsFunction/Arithmetic + options: + variables: [DerivedMetaData/elevation_diff_exp] + total exponent: -1. + - filter: Perform Action + filter variables: + - name: totalSnowDepth + where: + - variable: + name: ObsValue/totalSnowDepth + minvalue: 0. + action: + name: inflate error + inflation variable: DerivedMetaData/elevation_diff_exp_inv # 2.0 + - filter: BlackList + where: + - variable: + name: MetaData/stationIdentification + is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} + actions: + - name: set + flag: rejectlist + ignore: rejected observations + - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: totalSnowDepth + absolute threshold: 250 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject + diff --git a/parm/jcb-gdas/observations/soil/smap_soil.yaml.j2 b/parm/jcb-gdas/observations/soil/smap_soil.yaml.j2 new file mode 100644 index 000000000..760e5344e --- /dev/null +++ b/parm/jcb-gdas/observations/soil/smap_soil.yaml.j2 @@ -0,0 +1,196 @@ +- + + # Observation Space (I/O) + # ----------------------- + obs space: + name: {{observation_from_jcb}} + obsdatain: + engine: + type: H5File + obsfile: "{{soil_obsdatain_path}}/{{soil_obsdatain_prefix}}{{observation_from_jcb}}.nc" + missing file action: warn + obsdataout: + engine: + type: H5File + obsfile: "{{soil_obsdataout_path}}/{{soil_obsdataout_prefix}}{{observation_from_jcb}}{{soil_obsdataout_suffix}}" + simulated variables: [soilMoistureVolumetric] + # + + # Observation Operator + # -------------------- + obs operator: + name: Identity + # + + # Observation Filters (QC) + # ------------------------ + obs pre filters: + - filter: Create Diagnostic Flags + flags: + - name: missing_smc + initial value: false +# - name: missing_elevation +# initial value: false + - name: invalid_smc + initial value: false +# - name: invalid_elevation +# initial value: false + - name: land_check + initial value: false + - name: landice_check + initial value: false + - name: seaice_check + initial value: false + - name: snow_check + initial value: false + - name: retrv_qual_check + initial value: false + - name: vegtype_check + initial value: false + - name: elevation_bkgdiff + initial value: false +# - name: rejectlist +# initial value: false + - name: background_check + initial value: false + - filter: Perform Action + filter variables: + - name: soilMoistureVolumetric + action: + name: assign error + error parameter: 0.20 + - filter: Domain Check + where: + - variable: + name: ObsValue/soilMoistureVolumetric + value: is_valid + actions: + - name: set + flag: missing_smc + ignore: rejected observations + - name: reject +# - filter: Domain Check +# where: +# - variable: +# name: MetaData/stationElevation +# value: is_valid +# actions: +# - name: set +# flag: missing_elevation +# ignore: rejected observations +# - name: reject + obs prior filters: + - filter: Bounds Check + filter variables: + - name: soilMoistureVolumetric + minvalue: 0.0 + maxvalue: 1.0 + actions: + - name: set + flag: invalid_smc + ignore: rejected observations + - name: reject + - filter: Domain Check # land only + where: + - variable: + name: GeoVaLs/fraction_of_land + minvalue: 0.5 + actions: + - name: set + flag: land_check + ignore: rejected observations + - name: reject +# - filter: Domain Check +# where: +# - variable: +# name: MetaData/stationElevation +# minvalue: -200.0 +# maxvalue: 9000.0 +# actions: +# - name: set +# flag: invalid_elevation +# ignore: rejected observations +# - name: reject + - filter: Domain Check # land only, no sea ice + where: + - variable: + name: GeoVaLs/fraction_of_ice + maxvalue: 0.0 + actions: + - name: set + flag: seaice_check + ignore: rejected observations + - name: reject + - filter: Domain Check # no snow + where: + - variable: + name: GeoVaLs/sheleg + maxvalue: 0.0 + actions: + - name: set + flag: snow_check + ignore: rejected observations + - name: reject + - filter: Domain Check # high-quality retrievals + where: + - variable: + name: PreQC/soilMoistureVolumetric + is_in: 0, 8 + actions: + - name: set + flag: retrv_qual_check + ignore: rejected observations + - name: reject + - filter: RejectList # no land-ice + where: + - variable: + name: GeoVaLs/vtype + minvalue: 14.5 + maxvalue: 15.5 + actions: + - name: set + flag: landice_check + ignore: rejected observations + - name: reject + - filter: RejectList # exclude certain IGBP vegetation types + where: + - variable: + name: GeoVaLs/vtype + absolute_tolerance: 1.0e-3 + is_close_to_any_of: [1, 2, 3, 4, 13, 15, 17] + actions: + - name: set + flag: vegtype_check + ignore: rejected observations + - name: reject +# - filter: Difference Check # elevation check +# reference: MetaData/stationElevation +# value: GeoVaLs/filtered_orography +# threshold: 800. +# actions: +# - name: set +# flag: elevation_bkgdiff +# ignore: rejected observations +# - name: reject +# - filter: BlackList +# where: +# - variable: +# name: MetaData/stationIdentification +# is_in: {{ get_conventional_rejected_stations(observation_from_jcb) }} +# actions: +# - name: set +# flag: rejectlist +# ignore: rejected observations +# - name: reject + obs post filters: + - filter: Background Check # gross error check + filter variables: + - name: soilMoistureVolumetric + #threshold: 5 + absolute threshold: 0.5 + bias correction parameter: 1.0 + actions: + - name: set + flag: background_check + ignore: rejected observations + - name: reject diff --git a/parm/jcb-gdas/test/client_integration/gdas-atmosphere-templates.yaml b/parm/jcb-gdas/test/client_integration/gdas-atmosphere-templates.yaml new file mode 100644 index 000000000..4e57bd759 --- /dev/null +++ b/parm/jcb-gdas/test/client_integration/gdas-atmosphere-templates.yaml @@ -0,0 +1,165 @@ +# This part is for testing only. Normally this would just show algorithm: +# ----------------------------------------------------------------------------------- +supported_algorithms: +- 3dvar +- hofx3d +- hofx4d +- local_ensemble_da +# Local algorithms +- fv3jedi_fv3inc_lgetkf +- fv3jedi_fv3inc_variational + +# This is overwritten in the testing but allows command line test of jcb +algorithm: fv3jedi_fv3inc_lgetkf + +# Search path for model and obs for JCB (relative for the submodule, or can be absolute) +# -------------------------------------------------------------------------------------- +app_path_algorithm: gdas/algorithm/atmosphere +app_path_model: gdas/model/atmosphere +app_path_observations: gdas/observations/atmosphere +app_path_observation_chronicle: gdas/observation_chronicle/atmosphere + + +# Places where we deviate from the generic file name of a yaml +# ------------------------------------------------------------ +final_increment_file: atmosphere_final_increment_gaussian +output_ensemble_increments_file: atmosphere_output_ensemble_increments_gaussian +model_file: atmosphere_model_pseudo +initial_condition_file: atmosphere_background +background_error_file: atmosphere_background_error_hybrid_gsibec_bump + + +# Global analysis things +# ---------------------- +window_begin: '2024-02-01T00:00:00Z' +window_length: PT6H +bound_to_include: begin +minimizer: DRPCG +final_diagnostics_departures: anlmob +analysis_variables: [eastward_wind,northward_wind,air_temperature,air_pressure_at_surface,water_vapor_mixing_ratio_wrt_moist_air,ice_wat,liq_wat,o3mr] +number_of_outer_loops: 2 + +# Testing +# ------- + +do_testing: false + +# Model things +# ------------ +atmosphere_layout_x: 2 +atmosphere_layout_y: 2 +atmosphere_npx_ges: 361 +atmosphere_npy_ges: 361 +atmosphere_npz_ges: 127 +atmosphere_npx_his: 361 +atmosphere_npy_his: 361 +atmosphere_npz_his: 127 +atmosphere_npx_anl: 361 +atmosphere_npy_anl: 361 +atmosphere_npz_anl: 127 +atmosphere_fv3jedi_files_path: DATA/fv3jedi + +# Background +atmosphere_background_path: DATA/bkg +atmosphere_background_ensemble_path: "DATA/ens/mem%mem%" + +atmosphere_variational_history_prefix: "bkg_" +atmosphere_ensemble_history_prefix: "ens_" + +atmosphere_variational_analysis_prefix: "anl_" +atmosphere_ensemble_analysis_prefix: "anl_" + +atmosphere_background_time_iso: '2024-02-02T00:00:00Z' + +# Background error +atmosphere_bump_data_directory: DATA/berror +atmosphere_gsibec_path: DATA/berror +atmosphere_number_ensemble_members: 3 +atmosphere_layout_gsib_x: 2 +atmosphere_layout_gsib_y: 2 + +# Minimization options +atmosphere_ninner_1: 4 +atmosphere_ninner_2: 2 +atmosphere_grad_red_1: 1e-5 +atmosphere_grad_red_2: 1e-5 + +# Forecasting +atmosphere_forecast_length: PT6H +atmosphere_forecast_timestep: PT1H + +# Write final increment on Gaussian grid in variational +atmosphere_variational_increment_type: "gaussian" +atmosphere_final_increment_prefix: "./anl/atminc." + +# Observation things +# ------------------ +observations: all_observations + +# JCB level option to replace obs filters +# --------------------------------------- +replace_obs_filters: + observations: + - abi_g16 + override_filters: + - filter: PreQC + maxvalue: 1.0 + action: + name: reject + +crtm_coefficient_path: "DATA/crtm/" + +# Naming conventions for observational files +atmosphere_obsdatain_path: DATA/obs +atmosphere_obsdatain_prefix: OPREFIX +atmosphere_obsdatain_suffix: ".2024020100.nc" + +atmosphere_obsdataout_path: DATA/diags +atmosphere_obsdataout_prefix: diag +atmosphere_obsdataout_suffix: "_2024020100.nc" + +# Naming conventions for bias correction files +atmosphere_obsbiasin_path: DATA/obs +atmosphere_obsbiasin_prefix: GPREFIX +atmosphere_obsbiasin_suffix: ".satbias.nc" +atmosphere_obsbiasin_acft_suffix: ".acft_out.nc" +atmosphere_obstlapsein_prefix: GPREFIX +atmosphere_obstlapsein_suffix: ".tlapse.txt" +atmosphere_obsbiascovin_prefix: GPREFIX +atmosphere_obsbiascovin_suffix: ".satbias_cov.nc" +atmosphere_obsbiascovin_acft_suffix: ".acft_out_cov.nc" + +atmosphere_obsbiasout_path: DATA/bc +atmosphere_obsbiasout_prefix: APREFIX +atmosphere_obsbiasout_suffix: ".satbias.nc" +atmosphere_obsbiasout_acft_suffix: ".acft_out.nc" +atmosphere_obsbiascovout_prefix: APREFIX +atmosphere_obsbiascovout_suffix: ".satbias_cov.nc" +atmosphere_obsbiascovout_acft_suffix: ".acft_out_cov.nc" + + +# Local Ensemble DA (LETKF) +# ------------------------- +local_ensemble_da_solver: Deterministic GETKF + +increment_variables: [ua,va,DZ,delp,t,ps,sphum,ice_wat,liq_wat,o3mr] + +# Veritcal localization for GETKF +vl_fraction_of_retained_variance: 0.750 +vl_lengthscale: 2.1 +vl_lengthscale_units: logp +inflation_rtps: 0.85 +inflation_rtpp: 0.0 +inflation_mult: 1.0 + +# Driver +driver_update_obs_config_with_geometry_info: true +driver_save_posterior_mean: false +driver_save_posterior_ensemble: false +driver_save_prior_mean: false +driver_save_posterior_mean_increment: false +driver_save_posterior_ensemble_increments: true + +# Diagnostics +atmosphere_ensemble_increment_prefix: "./anl/mem%{member}%/atminc." +atmosphere_posterior_output_gaussian: "./mem%{member}%/atmanl." diff --git a/parm/jcb-gdas/test/client_integration/gdas-marine-templates.yaml b/parm/jcb-gdas/test/client_integration/gdas-marine-templates.yaml new file mode 100644 index 000000000..b99a221bc --- /dev/null +++ b/parm/jcb-gdas/test/client_integration/gdas-marine-templates.yaml @@ -0,0 +1,112 @@ +# This part is for testing only. Normally this would just show algorithm: +# ----------------------------------------------------------------------------------- +supported_algorithms: +- hofx3d +- hofx4d +- 3dfgat +#- local_ensemble_da + + +# Search path for model and obs for JCB (relative for the submodule, or can be absolute) +# -------------------------------------------------------------------------------------- +app_path_model: gdas/model/marine +app_path_observations: gdas/observations/marine +app_path_observation_chronicle: gdas/observation_chronicle/marine + + +# Places where we deviate from the generic file name of a yaml +# ------------------------------------------------------------ +model_file: marine_model_pseudo +initial_condition_file: marine_background +background_error_file: marine_background_error_hybrid_diffusion_diffusion + + +# Global analysis things +# ---------------------- +window_begin: '2024-01-31T21:00:00Z' +window_length: PT6H +bound_to_include: begin +minimizer: RPCG +final_diagnostics_departures: oman +analysis_variables: [cicen, hicen, hsnon, socn, tocn, uocn, vocn, ssh] +number_of_outer_loops: 1 + + +# Model things +# ------------ +marine_soca_files_path: DATA/soca +marine_vt_levels: 25 +marine_stddev_time: '2024-01-31T21:00:00Z' + +# Background +marine_background_time: '2024-01-31T21:00:00Z' +marine_background_path: DATA/bkg + + +# Background error +marine_window_middle: '2024-02-01T00:00:00Z' +marine_number_ensemble_members: 3 + +# Forecasting +marine_forecast_timestep: PT1H + +# Minimization +marine_ninner_1: 3 +marine_grad_red_1: 1e-4 + +# Forecast states +marine_pseudo_model_states: +- date: '2024-01-31T21:00:00Z' + basename: base + ocn_filename: ocn + ice_filename: ice + read_from_file: true +- date: '2024-02-01T00:00:00Z' + basename: base + ocn_filename: ocn + ice_filename: ice + read_from_file: true +- date: '2024-02-01T03:00:00Z' + basename: base + ocn_filename: ocn + ice_filename: ice + read_from_file: true + +# Observation things +# ------------------ +observations: all_observations + +# Naming conventions for observational files +marine_obsdatain_path: DATA/obs +marine_obsdatain_prefix: OPREFIX +marine_obsdatain_suffix: ".2024020100.nc" + +marine_obsdataout_path: DATA/diags +marine_obsdataout_prefix: diag +marine_obsdataout_suffix: "_2024020100.nc" + +# Local Ensemble DA (LETKF) +# ------------------------- +local_ensemble_da_solver: Deterministic GETKF + +increment_variables: [cicen, hicen, hsnon, socn, tocn, uocn, vocn, ssh] + +# Veritcal localization for GETKF +vl_fraction_of_retained_variance: 0.750 +vl_lengthscale: 2.1 +vl_lengthscale_units: logp +inflation_rtps: 0.85 +inflation_rtpp: 0.0 +inflation_mult: 1.0 + +# Driver +driver_update_obs_config_with_geometry_info: true +driver_save_posterior_mean: false +driver_save_posterior_ensemble: false +driver_save_prior_mean: false +driver_save_posterior_mean_increment: false +driver_save_posterior_ensemble_increments: true + +# Diagnostics +marine_ensemble_increment_prefix: "./anl/mem%{member}%/atminc." +marine_posterior_output_gaussian: "./mem%{member}%/atmanl."