Skip to content

Commit

Permalink
fixed case sensitive file extensions
Browse files Browse the repository at this point in the history
reconcile linux nitpicking file names
  • Loading branch information
BBeltz1 committed Jul 1, 2024
1 parent 3ac60a3 commit e258269
Show file tree
Hide file tree
Showing 4 changed files with 100 additions and 4 deletions.
5 changes: 3 additions & 2 deletions _bookdown.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ rmd_files:
- "chapters/gom_salmon.Rmd"
- "chapters/grayseal.Rmd"
- "chapters/seabird_ne.Rmd"
- "chapters/species_groupings.Rmd"
- "chapters/species_groupings.rmd"
#
#
# #################### OCEANOGRAPHIC ##################
Expand Down Expand Up @@ -90,6 +90,7 @@ rmd_files:
#
#
# ######################## LEGACY PAGES ##################
- "chapters/sectionHeaders/legacy.rmd"
- "chapters/erddap_query_and_build.Rmd"
- "chapters/Annual_SST_cycle_indicator.Rmd"
- "chapters/bottom_temperature_GLORYS.Rmd"
Expand All @@ -113,7 +114,7 @@ rmd_files:
- "chapters/Species_density_estimates.Rmd"
- "chapters/stom_fullness.Rmd"
- "chapters/storminess.Rmd"
#- "chapters/survey_data.Rmd"
- "chapters/survdat.rmd"
- "chapters/Thermal_hab_proj_indicator.Rmd"
- "chapters/Trend_analysis.Rmd"
- "chapters/observer_data_indicator.Rmd"
Expand Down
1 change: 1 addition & 0 deletions chapters/sectionHeaders/legacy.rmd
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
# (PART\*) Legacy Pages {.unnumbered}
Binary file added imagesunnamed-chunk-84-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
98 changes: 96 additions & 2 deletions tech_doc.Rmd
Original file line number Diff line number Diff line change
Expand Up @@ -1585,7 +1585,7 @@ Analysis for right whale abundance estimates is based on methods by @Pace2017, a

Time series of right whale and calf abundance estimates were formatted for inclusion in the `ecodata` R package using this R [code](https://github.com/NOAA-EDAB/ecodata/blob/master/data-raw/get_narw.R).

<!--chapter:end:chapters/narw.Rmd-->
<!--chapter:end:chapters/narw.rmd-->

```{r include=FALSE, cache=FALSE}
# example R options set globally
Expand Down Expand Up @@ -1952,7 +1952,7 @@ Species lists are pulled from SVDBS and CFDBS. They are merged using the ITIS c



<!--chapter:end:chapters/species_groupings.Rmd-->
<!--chapter:end:chapters/species_groupings.rmd-->

```{r include=FALSE, cache=FALSE}
# example R options set globally
Expand Down Expand Up @@ -3981,6 +3981,20 @@ Code used to analyze this data can be [found here](https://github.com/NOAA-EDAB/
# example R options set globally
options(width = 60)
# example chunk options set globally
knitr::opts_chunk$set(
comment = "#>",
collapse = TRUE
)
```
# (PART\*) Legacy Pages {.unnumbered}

<!--chapter:end:chapters/sectionHeaders/legacy.rmd-->

```{r include=FALSE, cache=FALSE}
# example R options set globally
options(width = 60)
# example chunk options set globally
knitr::opts_chunk$set(
comment = "#>",
Expand Down Expand Up @@ -5419,6 +5433,86 @@ No associated catalog page
# example R options set globally
options(width = 60)
# example chunk options set globally
knitr::opts_chunk$set(
comment = "#>",
collapse = TRUE
)
```
# Survey Data {#survdat}

**Description**: Survdat (Survey database)

**Found in**: State of the Ecosystem - Gulf of Maine & Georges Bank (2017+), State of the Ecosystem - Mid-Atlantic (2017+)

**Indicator category**: Database pull

**Contributor(s)**: Andy Beet

**Data steward**: Andy Beet <[email protected]>

**Point of contact**: Andy Beet <[email protected]>

**Public availability statement**: Source data are available to qualified researchers upon request (see "Access Information" [here](https://inport.nmfs.noaa.gov/inport/item/22560)).

***Note: Due to the COVID-19 pandemic there were no surveys in 2020***

## Methods
The Northeast Fisheries Science Center (NEFSC) has been conducting standardized bottom trawl surveys in the fall since 1963 and spring since 1968. The surveys follow a stratified random design. Fish species and several invertebrate species are enumerated on a tow by tow basis [@Azarovitz1981]. The data are housed in the NEFSC's survey database (SVDBS) maintained by the Ecosystem Survey Branch.

Direct pulls from the database are not advisable as there have been several gear modifications and vessel changes over the course of the time series [@Miller_2010]. Survdat was developed as a database query that applies the appropriate calibration factors for a seamless time series since the 1960s. As such, it is the base for many of the other analyses conducted for the State of the Ecosystem report that involve fisheries independent data.

The R package [`survdat`](https://noaa-edab.github.io/survdat/) is used to pull and process the data. For the purposes of the State of the Ecosystem reports only the spring and fall data are used. `survdat` identifies those research cruises associated with the seasonal bottom trawl surveys and pulls the station and biological data. Station data includes tow identification (cruise, station, and stratum), tow location and date, as well as several environmental variables (depth, surface/bottom salinity, and surface/bottom temperature). Stations are filtered using a station, haul, gear (SHG) code for tows prior to 2009 and a tow, operations, gear, and aquisition (TOGA) code from 2009 onward. The codes that correspond to a representative tow (SHG <= 136 or TOGA <= 1324) are the same used by assessment biologists at the NEFSC. Biological data includes the total biomass and abundance by species, as well as lengths and number at length.

`survdat` applies the calibration factors. There are four calibrartion factors applied (Table \@ref(tab:calibration)). Calibration factors are pulled directly from SVDBS. Vessel conversions were made from either the NOAA Ship *Delaware II* or NOAA Ship *Henry Bigelow* to the NOAA Ship *Albatross IV* which was the primary vessel for most of the time series. The Albatross was decommissioned in 2009 and the Bigelow is now the primary vessel for the bottom trawl survey.

```{r calibration, eval = T, echo = F}
cal.factors <- data.frame(Name = c('Door Conversion', 'Net Conversion', 'Vessel Conversion I', 'Vessel Conversion II'),
Code = c('DCF', 'GCF', 'VCF', 'BCF'),
Applied = c('<1985', '1973 - 1981 (Spring)', 'Delaware II records', 'Henry Bigelow records'))
kable(cal.factors, booktabs = TRUE,
caption = "Calibration factors for NEFSC trawl survey data")
```


### Data sources

[`survdat`](https://noaa-edab.github.io/survdat/) is an R package that allows for queries of the NEFSC survey database (SVDBS).These data are available to qualified researchers upon request. More information on the data request process is available under the "Access Information" field [here](https://inport.nmfs.noaa.gov/inport/item/22560).

### Data extraction

Extraction methods are described above. The R package [`survdat`](https://noaa-edab.github.io/survdat/) was used in the survey data extraction process.


### Data analysis

The fisheries independent data obtained using `survdat` is used in a variety of
products; the more complicated analyses are detailed in their own sections. The most straightforward use of this data is for the resource species aggregate biomass
indicators. For the purposes of the aggregate biomass indicators, fall and spring
survey data are treated separately. Additionally, all length data is dropped and
species separated by sex at the catch level are merged back together.

Since 2020, survey strata where characterized as being within an [Ecological Production Unit](#epu) based on where at least 50% of the area of the strata was located (Figure \@ref(fig:epustrata). While this does not create a perfect match for the EPU boundaries it allows us to calculate the variance associated with the index as the survey was designed.


```{r epustrata, fig.cap="Map of the Northeast Shelf broken into the four Ecological Production Units by strata.Strata were assigned to an EPU based on which one contained at least 50% of the area of the strata." , out.width="90%",echo = F}
knitr::include_graphics(file.path(image.dir,"EPU_Designations_Map.jpg"))
```


Prior to 2020, `survdat` would post stratified into EPUs by labeling stations with the EPU that contained them. The total number of stations within each EPU per year was counted using unique station records. Biomass was summed by species per year per EPU. Those sums were divided by the appropriate station count to get the EPU mean. Finally, the mean biomasses were summed by [aggregate groups](#species_groupings).

**catalog link**
No associated catalog page

<!--chapter:end:chapters/survdat.rmd-->

```{r include=FALSE, cache=FALSE}
# example R options set globally
options(width = 60)
# example chunk options set globally
knitr::opts_chunk$set(
comment = "#>",
Expand Down

0 comments on commit e258269

Please sign in to comment.