Wx update for multiple locations

[tevpg]

Perform Wx updates using a statiod id for various Canadian locations

General approach:

• ORG table would inlcude a WX_STATION column
• (ORG table is managed by hand)
• WX_STATION comes from https://collaboration.cmc.ec.gc.ca/cmc/climate/Get_More_Data_Plus_de_donnees/Station%20Inventory%20EN.csv:
  • "Station ID" column is the station id
  • CHeck the DLY Start Year and DLY End Year in selecting a station ... want one that extends to the current year
  • That value goes into the WX_STATION column
• general URL to fetch data is wget --content-disposition "https://climate.weather.gc.ca/climate_data/bulk_data_e.html?format=csv&stationID=1706&Year={year}&Month={month}&Day=14&timeframe=2&submit= Download+Data"

Automation script

• parameters
  • ORG_HANDLE (or org_id? or wildcard to do them all?)
  • YEAR (or maybe YEAR and MONTH?)
• assumes WX_STATION is already populated
• fetch WX_STATION
• fetch CSV for station/year from nrcan
• parse; update database rows for anything that matches