Netcdf meta data (shear probes): Difference between revisions

From Atomix
No edit summary
KikiSchulz (talk | contribs)
 
(28 intermediate revisions by 5 users not shown)
Line 1: Line 1:
== Meta data (shear probes) ==
<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.


'''In progress''' <br>
The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.




Line 9: Line 10:
{| class="wikitable sortable"
{| class="wikitable sortable"
|-
|-
! Parameter Name !! Description
! Attibute Name !! Description !! Convention
|-
|title || A comprehensive title for the dataset including the time and location aspect || CF, ACDD
|-
|authors ||  A list of authors || ATOMIX
|-
|summary || An abstract describing the dataset || ACCD
|-
|comment|| Supplementary technical details about the collecting and processing of the dataset || CF, ACDD
|-
|platform_type || The platform from which the data are collected, e.g., sub-surface mooring, research vessel, sub-surface glider || ACDD
|-
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|source || The instrument used for collecting the data. For example, vertical microstructure profiler, VMP2000 SN009 || CF, ACDD
|-
|-
|summary || required by ACDD  
|date_created || The date on which the data were created, yyyy-mm-ddTHH:MM:SSZ || ACDD
|-
|-
|comment|| required by CF
|date_modified || The date on which the data were last modified, yyyy-mm-ddTHH:MM:SSZ || ACDD
|-
|-
|platform_type ||research vessel, sub-surface glider etc
|time_reference_year || Year for time reference || ATOMIX
|-
|-
|creation_time || yyyy-mm-ddTHH:MM:SSZ  
|time_coverage_start || Time of the first data point in the dataset, yyyy-mm-ddTHH:MM:SSZ || ACDD
|-
|-
|date_created || yyyy-mm-ddTHH:MM:SSZ  
|time_coverage_end || Time of thelast data point in the dataset, yyyy-mm-ddTHH:MM:SSZ ||ACDD
|-
|-
|date_update || yyyy-mm-ddTHH:MM:SSZ
|geospatial_lat_min || Southern bound of data, decimal degrees, negative for South || ACDD
|-
|-
|time_reference_year || year for time reference
|geospatial_lat_max || Northern bound of data, decimal degrees, negative for South || ACDD
|-
|-
| fs_fast || sampling frequency for fast channels
|geospatial_lon_min || Western bound of data, decimal degrees, negative for West || ACDD
|-
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|geospatial_lon_max || Eastern bound of data, decimal degrees, negative for West || ACDD
|-
|-
| profiling_direction || horizontal, vertical, glide
| fs_fast || Sampling frequency for fast (turbulence) channels || ATOMIX
|-
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
| fs_slow <math>^a</math> || Sampling frequency for slow channels (if exists). Alternative names could be, e.g., fs_CTD || ATOMIX
|-
|-
| diss_length  || as data points
| profiling_direction || Direction along which the section was collected, e.g., horizontal, vertical, or glide || ATOMIX
|-
|-
| overlap ||  as data points
| fft_length ||  Length of the Fast Fourier transform segments (in data points; note, fft_lengths_sec in seconds is optional) || ATOMIX
|-
|-
| goodman  || 0=not applied; 1=applied
| diss_length  || Length of data (in data points) used for each dissipation estimate || ATOMIX
|-
| overlap ||  Length of overlap (in data points) in diss_length || ATOMIX
|-
| goodman  || Flag for the vibration coherent noise removal using the Goodman algorithm. 0=not applied; 1=applied || ATOMIX
|-
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
| HP_cut  || The high-pass filter cutoff frequency in Hz. Can be zero for no filtering. || ATOMIX
|-
|-
| history || Version 1
| conventions || A comma-separated list of the conventions that are followed by the dataset. e.g., CF-1.6, ACDD-1.3, ATOMIX || CF, ACDD
|-
|-
| data_mode || D #(D)elayed
| history || Provides an audit trail for modifications to the original data; e.g., Version 1 || CF, ACDD
|}
|}
<math>^a</math> or fast_cdt or similar if such records are included
It is highly recommended to duplicate relevant attributes at the corresponding
group level. Attributes not listed in the Climate and Forecast (CF) and the Attribute Convention for Data Discovery (ACDD)
standards are labeled as ATOMIX.
</div>
</div>


Line 55: Line 72:
{| class="wikitable sortable"
{| class="wikitable sortable"
|-
|-
! Parameter Name !! Description
! Attribute Name !! Description !! Convention
|-
| fft_length_sec ||  Length of the Fast Fourier transform segments in seconds || ATOMIX
|-
| diss_length_sec  || Dissipation estimate data length in seconds || ATOMIX
|-
|-
| fft_length_sec ||  seconds
| overlap_sec ||  Length of overlap (in seconds) in diss_length_sec || ATOMIX
|-
|-
| diss_length_sec || seconds
| f_AA || The anti-aliasing frequency in Hz || ATOMIX
|-
|-
| overlap_sec ||  seconds
| FOM_limit ||  Figure of merit limit for quality assurance. Typically between 1.15 and 1.4. || ATOMIX
|-
|-
|area ||         e.g., Arctic Ocean, Barents Sea
| diss_ratio_limit || The limit to identify anomalously large disagreement between dissipation estimates from probes. The magnitude of the difference of the natural logarithm of two dissipation estimates should be smaller than diss_ratio_limit <math>\times \sigma_{\ln \varepsilon}</math>. Typically, 2.77. || ATOMIX
|-
|-
|geospatial_lat_min ||
| despike_shear_fraction_limit || The maximum allowed fraction of data (of each diss_length_sec length) removed by de-spiking. Typically, 0.05. || ATOMIX
|-
|-
|geospatial_lat_max ||
| despike_shear_iterations_limit || The maximum number of allowed iterations of de-spiking when producing the L2 shear probe data (one value per section). Typically 8. || ATOMIX
|-
|-
|geospatial_lon_min ||
| variance_resolved_limit || The minimum fraction of variance resolved in an estimate by spectral integration. Typically 0.6. || ATOMIX
|-
|-
|geospatial_lon_max ||
| f_limit || The upper limit to exclude frequencies from analysis. Typically infinity. || ATOMIX
|-
|-
|geospatial_vertical_min|| 0
| fit_2_isr || Dissipation threshold for using the method of fitting in the inertial subrange. Typically <math>10^{−5}</math> W kg<math>^{−1}</math>. || ATOMIX
|-
|-
|geospatial_vertical_max|| in m
| spectral_model || The model shear spectrum used in dissipation estimates with the integration method: e.g., Nasmyth, Lueck or Panchev-Kesich || ATOMIX
|-
|-
|geospatial_vertical_positive|| down, up
|area || The region where the data were collected, e.g., Arctic Ocean, Barents Sea || ATOMIX
|-
|-
|time_coverage_start || yyyy-mm-ddTHH:MM:SSZ
|geospatial_vertical_min|| Further refinement of the geospatial bounding box. Vertical minimum in m || ACDD
|-
|-
|time_coverage_end || yyyy-mm-ddTHH:MM:SSZ
|geospatial_vertical_max|| Further refinement of the geospatial bounding box. Vertical maximum in m || ACDD
|-
|-
|institution ||  
|geospatial_vertical_positive|| Direction of positive vertical: down, up || ACDD
|-
|-
|principal_investigator ||
|institution ||  The name of the institution principally responsible for originating this data || CF, ACDD
|-
|-
|authors ||  
|principal_investigator || Name of the principal investigator who created the data || ATOMIX
|-
|-
|contact ||
|contact || Name of the contact person || ACDD
|-
|-
|project_name ||
|project || The scientific project that produced the data || ACDD
|-
|-
|cruise ||  
|cruise || The name or number of the research cruise || ATOMIX
|-
|-
|vessel ||  
|vessel || The name of the research vessel || ATOMIX
|-
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g.  “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|references || A list of related references || CF, ACDD
|-
|-
|references ||
|keywords || A comma-separated list of keywords and phrases || ACDD
|-
|-
|keywords ||
|creator_name || The data creator’s name || ACDD
|-
|-
|creator_name ||
|creator_email || The data creator’s email || ACDD
|-
|-
|creator_email ||
|creator_url || The data creator’s URL || ACDD
|-
|-
|creator_url ||
|acknowledgement|| Acknowledgement of support for the project that produced this data || ACDD
|-
|-
|acknowledgement||
|station_name || The name of the station where data were collected || ATOMIX
|-
|-
|station_name ||
|license || Provide the URL to a standard or specific license, e.g, http://creativecommons.org/licenses/by/4.0/, Freely Distributed, or None || ACDD
|}
|}



Latest revision as of 19:51, 24 May 2024


Below we list the metadata required in a NetCDF data file, as well as the optional meta data we highly recommend that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.


Required Metadata


Attibute Name Description Convention
title A comprehensive title for the dataset including the time and location aspect CF, ACDD
authors A list of authors ATOMIX
summary An abstract describing the dataset ACCD
comment Supplementary technical details about the collecting and processing of the dataset CF, ACDD
platform_type The platform from which the data are collected, e.g., sub-surface mooring, research vessel, sub-surface glider ACDD
source The instrument used for collecting the data. For example, vertical microstructure profiler, VMP2000 SN009 CF, ACDD
date_created The date on which the data were created, yyyy-mm-ddTHH:MM:SSZ ACDD
date_modified The date on which the data were last modified, yyyy-mm-ddTHH:MM:SSZ ACDD
time_reference_year Year for time reference ATOMIX
time_coverage_start Time of the first data point in the dataset, yyyy-mm-ddTHH:MM:SSZ ACDD
time_coverage_end Time of thelast data point in the dataset, yyyy-mm-ddTHH:MM:SSZ ACDD
geospatial_lat_min Southern bound of data, decimal degrees, negative for South ACDD
geospatial_lat_max Northern bound of data, decimal degrees, negative for South ACDD
geospatial_lon_min Western bound of data, decimal degrees, negative for West ACDD
geospatial_lon_max Eastern bound of data, decimal degrees, negative for West ACDD
fs_fast Sampling frequency for fast (turbulence) channels ATOMIX
fs_slow [math]\displaystyle{ ^a }[/math] Sampling frequency for slow channels (if exists). Alternative names could be, e.g., fs_CTD ATOMIX
profiling_direction Direction along which the section was collected, e.g., horizontal, vertical, or glide ATOMIX
fft_length Length of the Fast Fourier transform segments (in data points; note, fft_lengths_sec in seconds is optional) ATOMIX
diss_length Length of data (in data points) used for each dissipation estimate ATOMIX
overlap Length of overlap (in data points) in diss_length ATOMIX
goodman Flag for the vibration coherent noise removal using the Goodman algorithm. 0=not applied; 1=applied ATOMIX
HP_cut The high-pass filter cutoff frequency in Hz. Can be zero for no filtering. ATOMIX
conventions A comma-separated list of the conventions that are followed by the dataset. e.g., CF-1.6, ACDD-1.3, ATOMIX CF, ACDD
history Provides an audit trail for modifications to the original data; e.g., Version 1 CF, ACDD

It is highly recommended to duplicate relevant attributes at the corresponding group level. Attributes not listed in the Climate and Forecast (CF) and the Attribute Convention for Data Discovery (ACDD) standards are labeled as ATOMIX.

Optional Metadata


Attribute Name Description Convention
fft_length_sec Length of the Fast Fourier transform segments in seconds ATOMIX
diss_length_sec Dissipation estimate data length in seconds ATOMIX
overlap_sec Length of overlap (in seconds) in diss_length_sec ATOMIX
f_AA The anti-aliasing frequency in Hz ATOMIX
FOM_limit Figure of merit limit for quality assurance. Typically between 1.15 and 1.4. ATOMIX
diss_ratio_limit The limit to identify anomalously large disagreement between dissipation estimates from probes. The magnitude of the difference of the natural logarithm of two dissipation estimates should be smaller than diss_ratio_limit [math]\displaystyle{ \times \sigma_{\ln \varepsilon} }[/math]. Typically, 2.77. ATOMIX
despike_shear_fraction_limit The maximum allowed fraction of data (of each diss_length_sec length) removed by de-spiking. Typically, 0.05. ATOMIX
despike_shear_iterations_limit The maximum number of allowed iterations of de-spiking when producing the L2 shear probe data (one value per section). Typically 8. ATOMIX
variance_resolved_limit The minimum fraction of variance resolved in an estimate by spectral integration. Typically 0.6. ATOMIX
f_limit The upper limit to exclude frequencies from analysis. Typically infinity. ATOMIX
fit_2_isr Dissipation threshold for using the method of fitting in the inertial subrange. Typically [math]\displaystyle{ 10^{−5} }[/math] W kg[math]\displaystyle{ ^{−1} }[/math]. ATOMIX
spectral_model The model shear spectrum used in dissipation estimates with the integration method: e.g., Nasmyth, Lueck or Panchev-Kesich ATOMIX
area The region where the data were collected, e.g., Arctic Ocean, Barents Sea ATOMIX
geospatial_vertical_min Further refinement of the geospatial bounding box. Vertical minimum in m ACDD
geospatial_vertical_max Further refinement of the geospatial bounding box. Vertical maximum in m ACDD
geospatial_vertical_positive Direction of positive vertical: down, up ACDD
institution The name of the institution principally responsible for originating this data CF, ACDD
principal_investigator Name of the principal investigator who created the data ATOMIX
contact Name of the contact person ACDD
project The scientific project that produced the data ACDD
cruise The name or number of the research cruise ATOMIX
vessel The name of the research vessel ATOMIX
references A list of related references CF, ACDD
keywords A comma-separated list of keywords and phrases ACDD
creator_name The data creator’s name ACDD
creator_email The data creator’s email ACDD
creator_url The data creator’s URL ACDD
acknowledgement Acknowledgement of support for the project that produced this data ACDD
station_name The name of the station where data were collected ATOMIX
license Provide the URL to a standard or specific license, e.g, http://creativecommons.org/licenses/by/4.0/, Freely Distributed, or None ACDD

return to Dataset requirements for shear probes