Alternative NC formats enabled #16
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…attributes files. Separated out some utilities. Remove generate_nc_raw_file_att, no longer required. First draft.
…y code where we aren't writing test probes out. Also a whole lot of minor formatting edits in the code.
…in ed and raw files.
… Still need to check the salinity/conductivity names in older files. Will allow conversion of XCTD data too. Because the data read now uses a dataframe, later handling of the data has also changed as variable types have changed.
…gging of data handling after variable parsing changed to a dataframe. Call to write_output_nc now has a default of None for the raw file (Turo).
…rom an incorrect negative value. The *raw.nc files have the corrected value in the longitude variable, so LONGITUDE_RAW needs to be reconciled back to the value retained in the histories section.
…e size array as the TEMP variable for the case when a PLA has been applied and now TEMP has missing data at the end of the profile.
…e fields using the number of profiles.
…retains the platform code (callsign) even if empty.
…ft, sometimes from the right. Might be better to start using the 'time' field rather than these woce_date and woce_time fields.
…other than DEPTH_RAW). Eg, sound velocity, salinity etc.
…ngs as well as int and float.
… results when SYST is not in the surface parameters.
…o still have the histories section in the new format.
… on. Remove the breakpoint.
…ne NETCDF compliance checker)
Add automatic CSR flag addition on conversion
Add wire break test to conversion. Also fix some typos
… adjust write2netcdf.py to read from a csv file for the variables and attributes.
…f files common code between historic conversion and Turo conversion. Also a couple of bug fixes.
… and fix some other bugs.
Fix varnames
…ent types of data. Also add python notebook for parquet format checks.
Fix issues with HISTORY_PREVIOUS_VALUE handling as it contains differ…
…etcdfVars.csv file.
Update reading of surface codes and some other variables to use the n…
Update handling of edited and raw profiles with different lengths, eg when there is a PLA flag
…ted. Also fix some redundant code.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
netCDFvars.csv file and handling updated to enable user to decide on output netcdf format.No need to re-code if the variable names stay the same. Variables can be made into variables, attributes or global attributes.