Atomix - User contributions [en]

Benchmark datasets for shear probes

2024-06-14T06:51:42Z

PeterHoltermann: Description of Baltic Sea dataset

We compiled a collection of five benchmark data sets described in Scientific Data: [https://www.nature.com/articles/s41597-024-03323-y Fer et al. (2024)]

These datasets can be accessed from the BODC center.

We provide a number of Matlab routines to read in and compare data from grouped NetCDF files that follow our recommended structure on our [https://github.com/SCOR-ATOMIX/shear-probes GitHub repository]. The Matlab function ATOMIX_load.m there can be used to load a benchmark data file.

{| class="wikitable sortable"
|-
! Link
! Region
! Instrument
! Platform
! PI (ATOMIX)
! Comment
|-
| [https://doi.org/10.5285/0ec16a65-abdf-2822-e063-6c86abc06533]
| Haro Strait
| VMP-250
| Ship
| Lueck
| Intense turbulence. Large up/down drafts. Most estimates require fitting to the inertial subrange.
|-
| [https://doi.org/10.5285/0ebffc86-ed32-5dde-e063-6c86abc08b3a]
| Rockall Trough
| Epsilometer
| Ship
| Le Boyer
| Strong turbulence in a canyon in the North Atlantic (West of Ireland)
|-
| [https://doi.org/10.5285/05f21d1d-bf9c-5549-e063-6c86abc0b846]
| Faroe Bank Channel (North Atlantic)
| VMP-2000
| Ship
| Fer
| Ranging from quiescent mid-water to turbulent, deep gravity current
|-
| [https://doi.org/10.5285/0e35f96f-57e3-540b-e063-6c86abc06660]
| Baltic Sea
| MSS
| Ship
| Holtermann
| Non-tidal, low turbulence with increased mixing at the Baltic Sea halocline and bottom boundary turbulence
|-
| [https://doi.org/10.5285/0ec17274-7a64-2b28-e063-6c86abc0ee02]
| Minas Passage (Bay of Fundy, NS)
| MicroRider
| Mooring
| Lueck
| A swift tidal channel. All dissipation estimated from the inertial subrange
|-
|}

[[Category: Shear probes]]

-------------------------
return to [[Shear probes]] <br><br>
ATOMIX members: see also [[Tentative benchmarks for shear probes| tentative benchmarks for testers]]

Netcdf meta data (shear probes)

2023-11-22T18:16:16Z

PeterHoltermann:

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || E.g., Vertical micostructure profiler data from cruise XXX
|-
|authors || Names of authors
|-
|summary || An abstract describing the dataset
|-
|comment|| Supplementary technical details about the collecting and processing of the dataset
|-
|platform_type || The platform from which the data are collected. From the SeaVoX Platform Categories (L06) list,
e.g. sub-surface mooring, research vessel, sub-surface glider
|-
|source || The instrument used for collecting the data. For example, vertical microstructure profiler, VMP2000 SN009.
|-
|date_created || The date on which the data was created, yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || The date on which the data was last modified, yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || Year for time reference
|-
|time_coverage_start || Time of the first data point in the dataset, yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || Time of thelast data point in the dataset, yyyy-mm-ddTHH:MM:SSZ
|-
|geospatial_lat_min || Southern bound of data, decimal degrees, negative for South
|-
|geospatial_lat_max || Northern bound of data, decimal degrees, negative for South
|-
|geospatial_lon_min || Western bound of data, decimal degrees, negative for West
|-
|geospatial_lon_max || Eastern bound of data, decimal degrees, negative for West
|-
| fs_fast || Sampling frequency for fast (turbulence) channels
|-
| fs_slow <math>^a</math> || Sampling frequency for slow channels (if exist)
|-
| profiling_direction || E.g., horizontal, vertical, or glide
|-
| fft_length || Length of the Fast Fourier transform segments (in data points; note, fft_lengths_sec in seconds is optional)
|-
| diss_length || Length of data (in data points) used for each dissipation estimate
|-
| overlap || Length of overlap (in data points) in diss_length
|-
| goodman || Vibration coherent noise removal using the Goodman algorithm. 0=not applied; 1=applied
|-
| HP_cut || The high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || A comma-separated list of the conventions that are followed by the dataset. e.g., CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Provides an audit trail for modifications to the original data; e.g., Version 1
|-
| data_mode || D (D)elayed
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-22T18:15:55Z

PeterHoltermann: required data table in sync with data descriptor paper

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|authors || Names of authors
|-
|summary || An abstract describing the dataset
|-
|comment|| Supplementary technical details about the collecting and processing of the dataset
|-
|platform_type || The platform from which the data are collected. From the SeaVoX Platform Categories (L06) list,
e.g. sub-surface mooring, research vessel, sub-surface glider
|-
|source || The instrument used for collecting the data. For example, vertical microstructure profiler, VMP2000 SN009.
|-
|date_created || The date on which the data was created, yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || The date on which the data was last modified, yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || Year for time reference
|-
|time_coverage_start || Time of the first data point in the dataset, yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || Time of thelast data point in the dataset, yyyy-mm-ddTHH:MM:SSZ
|-
|geospatial_lat_min || Southern bound of data, decimal degrees, negative for South
|-
|geospatial_lat_max || Northern bound of data, decimal degrees, negative for South
|-
|geospatial_lon_min || Western bound of data, decimal degrees, negative for West
|-
|geospatial_lon_max || Eastern bound of data, decimal degrees, negative for West
|-
| fs_fast || Sampling frequency for fast (turbulence) channels
|-
| fs_slow <math>^a</math> || Sampling frequency for slow channels (if exist)
|-
| profiling_direction || E.g., horizontal, vertical, or glide
|-
| fft_length || Length of the Fast Fourier transform segments (in data points; note, fft_lengths_sec in seconds is optional)
|-
| diss_length || Length of data (in data points) used for each dissipation estimate
|-
| overlap || Length of overlap (in data points) in diss_length
|-
| goodman || Vibration coherent noise removal using the Goodman algorithm. 0=not applied; 1=applied
|-
| HP_cut || The high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || A comma-separated list of the conventions that are followed by the dataset. e.g., CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Provides an audit trail for modifications to the original data; e.g., Version 1
|-
| data_mode || D (D)elayed
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-22T18:09:59Z

PeterHoltermann:

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|authors || Names of authors
|-
|summary || An abstract describing the dataset
|-
|comment|| Supplementary technical details about the collecting and processing of the dataset
|-
|platform_type || The platform from which the data are collected. From the SeaVoX Platform Categories (L06) list,
e.g. sub-surface mooring, research vessel, sub-surface glider
|-
|source || The instrument used for collecting the data. For example, vertical microstructure profiler, VMP2000 SN009.
|-
|date_created || The date on which the data was created, yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || The date on which the data was last modified, yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || Year for time reference
|-
|time_coverage_start || Time of the first data point in the dataset, yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || Time of thelast data point in the dataset, yyyy-mm-ddTHH:MM:SSZ
|-
| fs_fast || sampling frequency for fast channels
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|-
| profiling_direction || horizontal, vertical, glide
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
|-
| diss_length || as data points
|-
| overlap || (for diss_length) as data points
|-
| goodman || 0=not applied; 1=applied
|-
| HP_cut || the high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Version 1
|-
| data_mode || D #(D)elayed
|-
|geospatial_lat_min || latitude minimum of data
|-
|geospatial_lat_max || latitude maximum of data
|-
|geospatial_lon_min || longitude minimum of data
|-
|geospatial_lon_max || longitude maximum of data
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-22T18:06:05Z

PeterHoltermann: first part of the updated metadata

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|authors || Names of authors
|-
|summary || An abstract describing the dataset
|-
|comment|| Supplementary technical details about the collecting and processing of the dataset
|-
|platform_type || The platform from which the data are collected. From the SeaVoX Platform Categories (L06) list,
e.g. sub-surface mooring, research vessel, sub-surface glider
|-
|source || The instrument used for collecting the data. For example, vertical microstructure profiler, VMP2000 SN009.
|-
|creation_time || netCDF file creation time (required by CF-Standard). Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_created || same as "creation time". Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || Time of the latest revision: Format: yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || year for time reference
|-
| fs_fast || sampling frequency for fast channels
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|-
| profiling_direction || horizontal, vertical, glide
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
|-
| diss_length || as data points
|-
| overlap || (for diss_length) as data points
|-
| goodman || 0=not applied; 1=applied
|-
| HP_cut || the high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Version 1
|-
| data_mode || D #(D)elayed
|-
|geospatial_lat_min || latitude minimum of data
|-
|geospatial_lat_max || latitude maximum of data
|-
|geospatial_lon_min || longitude minimum of data
|-
|geospatial_lon_max || longitude maximum of data
|-
|time_coverage_start || yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || yyyy-mm-ddTHH:MM:SSZ
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-22T12:53:22Z

PeterHoltermann: Removed num_fft_segments (to be consistent with the data descriptor paper)

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|summary || required by ACDD
|-
|comment|| required by CF
|-
|platform_type ||research vessel, sub-surface glider etc
|-
|creation_time || netCDF file creation time (required by CF-Standard). Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_created || same as "creation time". Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || Time of the latest revision: Format: yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || year for time reference
|-
| fs_fast || sampling frequency for fast channels
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|-
| profiling_direction || horizontal, vertical, glide
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
|-
| diss_length || as data points
|-
| overlap || (for diss_length) as data points
|-
| goodman || 0=not applied; 1=applied
|-
| HP_cut || the high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Version 1
|-
| data_mode || D #(D)elayed
|-
|authors || Names of authors
|-
|geospatial_lat_min || latitude minimum of data
|-
|geospatial_lat_max || latitude maximum of data
|-
|geospatial_lon_min || longitude minimum of data
|-
|geospatial_lon_max || longitude maximum of data
|-
|time_coverage_start || yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || yyyy-mm-ddTHH:MM:SSZ
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Level 4 data (shear probes)

2023-11-22T12:48:36Z

PeterHoltermann: QC flag link in table

Level 4 data include the final dissipation estimates as time series, as well as indicators for the quality and accuracy of the estimates and additional derived parameters. It is saved in the NetCDF group "L4_dissipation". Each dissipation estimate in level 4 corresponds to a spectrum in the level 3 data. Consequently, the level 3 and 4 TIME dimensions are the same. Parameter EPSI_FINAL is the final dissipation rate estimate, averaged of the selected estimates (using the [[Quality_control_coding | QC flags]]) at that depth.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments
|-
|N_SHEAR_SENSORS ||number of shear channels (shear sensors)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimensions
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^c</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || unique_identifier_for_each_section _of_data_from_timeseries || - || TIME_SPECTRA
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME_SPECTRA ||
|-
| EPSI || specific_turbulent_kinetic_energy_dissipation _in_water || W kg-1 || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FINAL || specific_turbulent_kinetic_energy_dissipation _in_water || W kg-1 || TIME_SPECTRA
|-
| KMIN || minimum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| KMAX || maximum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| N_S || number_of_spectral_points_used_for_estimating_turbulent_kinetic_energy_dissipation || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FLAGS <math>^a</math> || dissipation_qc_flags || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| METHOD <math>^b</math>|| method_used_for_estimating_ turbulent_kinetic_energy_dissipation || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|}
<math>^a</math> [[Quality_control_coding | Quality control coding]] for the final dissipation estimate.

<math>^b</math> METHOD=0 for spectral integration, METHOD=1 for fitting to the inertial subrange.

<math>^c</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 4 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| KVISC || kinematic_viscosity_of_water || m2 s-1 || TIME_SPECTRA
|-
| FOM || figure_of_merit || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| MAD || mean_absolute_deviation || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| VAR_RESOLVED || variance_resolved || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_STD || expected_standard_deviation_of_the_ logarithm_of_the_dissipation_estimate || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| DESPIKE_FRACTION_SH || fraction_of_shear_data_modified_by_despiking_algorithm || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| DESPIKE_PASS_COUNT_SH || number_of_despike_passes_for_shear_probes || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|}

</div>

-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 3 data (shear probes)| Level 3 data]].
[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-16T12:06:40Z

PeterHoltermann: changed lat/lon from optional->required

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|summary || required by ACDD
|-
|comment|| required by CF
|-
|platform_type ||research vessel, sub-surface glider etc
|-
|creation_time || netCDF file creation time (required by CF-Standard). Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_created || same as "creation time". Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || Time of the latest revision: Format: yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || year for time reference
|-
| fs_fast || sampling frequency for fast channels
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|-
| profiling_direction || horizontal, vertical, glide
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
|-
| diss_length || as data points
|-
| overlap || (for diss_length) as data points
|-
| num_fft_segments || number of FFT segments
|-
| goodman || 0=not applied; 1=applied
|-
| HP_cut || the high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Version 1
|-
| data_mode || D #(D)elayed
|-
|authors || Names of authors
|-
|geospatial_lat_min || latitude minimum of data
|-
|geospatial_lat_max || latitude maximum of data
|-
|geospatial_lon_min || longitude minimum of data
|-
|geospatial_lon_max || longitude maximum of data
|-
|time_coverage_start || yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || yyyy-mm-ddTHH:MM:SSZ
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-16T12:05:04Z

PeterHoltermann: authors optional->required

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|summary || required by ACDD
|-
|comment|| required by CF
|-
|platform_type ||research vessel, sub-surface glider etc
|-
|creation_time || netCDF file creation time (required by CF-Standard). Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_created || same as "creation time". Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || Time of the latest revision: Format: yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || year for time reference
|-
| fs_fast || sampling frequency for fast channels
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|-
| profiling_direction || horizontal, vertical, glide
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
|-
| diss_length || as data points
|-
| overlap || (for diss_length) as data points
|-
| num_fft_segments || number of FFT segments
|-
| goodman || 0=not applied; 1=applied
|-
| HP_cut || the high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Version 1
|-
| data_mode || D #(D)elayed
|-
|authors || Names of authors
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_lat_min || latitude minimum of data
|-
|geospatial_lat_max || latitude maximum of data
|-
|geospatial_lon_min || longitude minimum of data
|-
|geospatial_lon_max || longitude maximum of data
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|time_coverage_start || yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || yyyy-mm-ddTHH:MM:SSZ
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Netcdf meta data (shear probes)

2023-11-02T12:06:46Z

PeterHoltermann: Added information about creation time etc., copied content from meeting minutes.

<br>
Below we list the metadata '''required''' in a NetCDF data file, as well as the optional meta data we '''highly recommend''' that are included with the data set.

The parameter names should be used as listed (attention to underscores). The descriptions are example text or several options that are available for that parameter.

=Required Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
|title || e.g., Vertical micostructure profiler data from cruise XXX
|-
|summary || required by ACDD
|-
|comment|| required by CF
|-
|platform_type ||research vessel, sub-surface glider etc
|-
|creation_time || netCDF file creation time (required by CF-Standard). Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_created || same as "creation time". Format: yyyy-mm-ddTHH:MM:SSZ
|-
|date_update || Time of the latest revision: Format: yyyy-mm-ddTHH:MM:SSZ
|-
|time_reference_year || year for time reference
|-
| fs_fast || sampling frequency for fast channels
|-
| fs_slow <math>^a</math> || sampling frequency for slow channels
|-
| profiling_direction || horizontal, vertical, glide
|-
| fft_length || as data points (note, fft_lengths_sec in seconds is optional)
|-
| diss_length || as data points
|-
| overlap || (for diss_length) as data points
|-
| num_fft_segments || number of FFT segments
|-
| goodman || 0=not applied; 1=applied
|-
| HP_cut || the high-pass filter cutoff frequency in Hz. Can be zero for no filtering.
|-
| conventions || CF-1.6, ACDD-1.3, ATOMIX
|-
| history || Version 1
|-
| data_mode || D #(D)elayed
|}
<math>^a</math> or fast_ctd or similar if such records are included
</div>

=Optional Metadata=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Description
|-
| fft_length_sec || seconds
|-
| diss_length_sec || seconds
|-
| overlap_sec || (for diss_length_sec) seconds
|-
| f_AA || Hz, the anti-aliasing frequency.
|-
| FOM_limit || non-dimensional, if absent the FOM QC-flag is not set. Typically, 1.15.
|-
| diss_ratio_limit || non-dimensional, if absent the dissipation ration QC-flag is not set. Typically, 2.77.
|-
| despike_shear_fraction_limit || non-dimensional, if absent the de-spike fraction QC-flag is not set. Typically, 0.05.
|-
| despike_shear_iterations_limit || non-dimensional, if absent the de-spike iteration passes QC-flag is not set. Typically 8.
|-
| variance_resolved_limit || threshold for the minimum percent of variance resolved in a shear spectrum. Typically 50%.
|-
| spectral_model || e.g., Nasmyth, Lueck or Panchev-Kesich
|-
| spectrum_std || statistical uncertainty (standard deviation) of the natural logarithm of spectrum of shear
|-
| num_vibration_goodman || number of vibration or acceleration time series used to clean the shear spectrum
|-
| f_limit || upper limit to exclude frequencies that have contaminations. Typically infinity.
|-
| fit_2_isr || dissipation threshold to use the method of fitting to the inertial subrange. Typically 10-5 W/kg.
|-
|eps_remove_top_meters || if applicable, upper meters removed from dissipation estimates (e.g., because of ship)
|-
|area || e.g., Arctic Ocean, Barents Sea
|-
|geospatial_lat_min || latitude minimum of data
|-
|geospatial_lat_max || latitude maximum of data
|-
|geospatial_lon_min || longitude minimum of data
|-
|geospatial_lon_max || longitude maximum of data
|-
|geospatial_vertical_min|| 0
|-
|geospatial_vertical_max|| in m
|-
|geospatial_vertical_positive|| down, up
|-
|time_coverage_start || yyyy-mm-ddTHH:MM:SSZ
|-
|time_coverage_end || yyyy-mm-ddTHH:MM:SSZ
|-
|institution || e.g. University of Bergen
|-
|principal_investigator || Name of Principal Investigator
|-
|authors || Names of authors
|-
|contact || email address of corresponding author (usually principal investigator)
|-
|project_name || name of project for which the data was collected
|-
|cruise || name of cruise from which the data was collected
|-
|vessel || name of vessel from which the data was collected
|-
|source || From the SeaVoX Platform Categories vocabulary (L06) list, e.g. “subsurface mooring”, ”ship”, ""sub-surface gliders"", ""autonomous underwater vehicle"" (CF)
|-
|references || key references
|-
|keywords || relevant keywords describing data e.g. shear probes
|-
|creator_name || name of person who generated the file
|-
|creator_email || email address of person who generated the file
|-
|creator_url || website address of the creator
|-
|acknowledgement|| acknowledgements for this data. e.g. this could include crew of ship or funders
|-
|station_name || name of station
|}

</div>

return to [[Dataset requirements for shear probes]]

[[Category:Shear probes]]

Level 1 data (shear probes)

2022-09-27T08:53:06Z

PeterHoltermann: /* Required Variables */

Level 1 data refers to the full resolution data in physical units, e.g. the regularly sampled time series of [[Convert the shear probe data|converted shear probe data]]. If needed, a transfer function for shear is given. Below, a table with parameters included in the level 1 data set is compiled. The parameter names and definitions fit the [[NetCDF parameter]] attributes and data is stored as a NetCDF group with the name "L1_converted".

In the standard names, "sea_water" can be replaced with "water" if working in freshwater environments. This is specified in some entries below but not all.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME || length of the record from turbulence (fast) data channels
|-
| TIME_*** <math>^a</math> || length of the record from the *** sensor (e.g., CTD or SLOW)
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> Typically we assume TIME for the fast-sampled microstructure channels, and for example, _SLOW or _CTD for slower sampled channels such as CTD and tilt sensors. If the application requires different time stamps for different sensors, this can be utilized like TIME_PITCH, TIME_ACC etc.
<br>
<math>^b</math> Please use these examples for related sensors:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors, <br>
N_ACC_SENSORS for vibration acceleration sensors, <br>
N_GRADT_SENSORS for thermistors, <br>
N_GRADC_SENSORS for microconductivity sensors. <br>
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^a</math> || TIME
|-
| SHEAR || sea_water_velocity_shear<br /> (or water_velocity_shear) || s-1 || [TIME, N_SHEAR_SENSORS]
|}
<math>^a</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 1 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME <math>^a</math>
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^b</math>, N_ACC_SENSORS]
|-
| TEMP || sea_water_temperature<br /> (water_temperature) || degree_Celsius || [TIME_CTD <math>^b</math>, N_T_SENSORS]
|-
| CNCD || sea_water_electrical_conductivity<br /> (water_electrical_conductivity) || S m-1 || [TIME_CTD <math>^b</math>, N_C_SENSORS]
|-
| GRADT || temperature_gradient || || [TIME, N_GRADT_SENSORS]
|-
| GRADC || conductivity_gradient || || [TIME, N_GRADC_SENSORS]
|-
| PITCH || platform_pitch_angle || degree || TIME <math>^a</math>
|-
| ROLL || platform_roll_angle || degree || TIME <math>^a</math>
|}
<math>^a</math> or TIME_SLOW or TIME_CTD
<br><math>^b</math> or TIME_SLOW
</div>

------
return to [[Dataset requirements for shear probes]] <br>
go to next: [[Level 2 data (shear probes)| Level 2 data]].

[[Category: Shear probes]]

Level 4 data (shear probes)

2022-09-27T08:48:49Z

PeterHoltermann:

Level 4 data include the final dissipation estimates as time series, as well as indicators for the quality and accuracy of the estimates and additional derived parameters. It is saved in the NetCDF group "L4_dissipation". Each dissipation estimate in level 4 corresponds to a spectrum in the level 3 data. Consequently, the level 3 and 4 TIME dimensions are the same. Parameter EPSI_FINAL is the final dissipation rate estimate, averaged of the selected estimates (using the [[Quality_control_coding | QC flags]]) at that depth.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments
|-
|N_SHEAR_SENSORS ||number of shear channels (shear sensors)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimensions
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^c</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || flow_past_sensor || m s-1 || TIME_SPECTRA ||
|-
| EPSI || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FINAL || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || TIME_SPECTRA
|-
| KMAX || maximum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FLAGS <math>^a</math> || dissipation_qc_flags || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| METHOD <math>^b</math>|| method_used_for_estimating_ turbulent_kinetic_energy_dissipation || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|}
<math>^a</math> Quality control coding for the final dissipation estimate.

<math>^b</math> METHOD=0 for spectral integration, METHOD=1 for fitting to the inertial subrange.

<math>^c</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 4 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| KVISC || kinematic_viscosity_of_water || m2 s-1 || TIME_SPECTRA
|-
| FOM || figure_of_merit || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| MAD || mean_absolute_deviation || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| VAR_RESOLVED || variance_resolved || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| KMIN || minimum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_STD || expected_standard_deviation_of_the_ logarithm_of_the_dissipation_estimate || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|}

</div>

-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 3 data (shear probes)| Level 3 data]].
[[Category:Shear probes]]

Level 3 data (shear probes)

2022-09-27T08:47:56Z

PeterHoltermann:

Level 3 data contains the raw (and optionally cleaned) [[Spectrum|spectra]] derived from level 2 time series and is saved in the NetCDF group "L3_spectra". Level 3 parameters are defined along a new TIME [[Netcdf dimensions (shear probes)|dimension]], which is the average time of the individual spectral segments. The length of the TIME dimension equals the number of spectral segments. Parameter for the calculation of the spectra, e.g. segment length, are provided in the [[Netcdf meta data (shear probes)|meta data]].

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments. This also equals time of dissipation estimates.
|-
| WAVENUMBER || length of the wavenumber array
|-
|N_SHEAR_SENSORS || number of shear channels (shear sensors)
|-
|N_***_SENSORS || number of *** channels (such as ACC and VIB)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^b</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME_SPECTRA
|-
| SH_SPEC || shear_probe_by spectrum || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|-
| KCYC || Cyclic wavenumber || cpm || [TIME_SPECTRA, WAVENUMBER]
|-
| DOF || degrees_of_freedom_of_spectrum || - || 1
|-
| SH_SPEC_CLEAN<math>^a</math>|| shear_probe_spectrum_clean || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|}
<math>^a</math> SH_SPEC_CLEAN must be included in the file if these spectra were used to compute <math>\varepsilon</math>

<math>^b</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 3 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| ACC_SPEC || acceleration_sensor_spectrum || m2 s-4 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS]
|-
| VIB_SPEC || vibration_sensor_spectrum || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS]
|-
| SH_VIB_SPEC ||shear_and_vibration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS*N_SHEAR_SENSORS]
|-
| SH_ACC_SPEC ||shear_and_acceleration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS*N_SHEAR_SENSORS]
|}
</div>

[[Category: Shear probes]]
-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 2 data (shear probes)| Level 2 data]]<br>
go to next: [[Level 4 data (shear probes)| Level 4 data]].

Level 2 data (shear probes)

2022-09-27T08:47:07Z

PeterHoltermann:

Level 2 data, that is saved in the NetCDF group "L2_cleaned", are the full resolution, cleaned and despiked parameters from level 1. The initial data set is subdivided in [[Section|sections]] and labeled accordingly in the parameter SECTION_NUMBER with integers. Level 2 data is ready for estimating spectra. In addition to cleaned and despiked level 1 data channels, level 2 data comprises the additional parameter summarized in the table below.

It is important that the platform speed with respect to water, as used in the dissipation estimates, is included in this level. Also note that the shear probe time series (and optionally acceleration and vibration) must be cleaned and filtered as needed at this level, and will not be altered further when estimating dissipation rates.

On all levels, "sea_water" in the standard name can be replaced by "water" for limnologic applications.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME <math>^a</math> || length of the record from turbulence (fast) data channels
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> At this level platform speed must be provided. We require that this is given at the shear probe time (not TIME_SLOW or TIME_CTD. Please interpolate if needed.
<br>
<math>^b</math> Please use these examples for related sensors, e.g.:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors <br>
N_ACC_SENSORS for vibration acceleration sensors
</div>

=Required Variables=

Pressure? Or more importantly the speed past the sensor
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| SECTION_NUMBER || || dimensionless || TIME
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^a</math> || TIME
|-
| SHEAR || sea_water_velocity_shear || s-1 || [TIME, N_SHEAR_SENSORS]
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME
|}
<math>^a</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 2 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^a</math>, N_ACC_SENSORS]
|}
<math>^a</math> If using TIME_SLOW or TIME_ACC, this must be provided in addition to the TIME record.
</div>

[[Category: Shear probes]]

------
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 1 data (shear probes)| Level 1 data]]<br>
go to next: [[Level 3 data (shear probes)| Level 3 data]].

Level 2 data (shear probes)

2022-09-27T08:45:31Z

PeterHoltermann: /* Required Variables */

Level 2 data are the full resolution, cleaned and despiked parameters from level 1. The initial data set is subdivided in [[Section|sections]] and labeled accordingly in the parameter SECTION_NUMBER with integers. Level 2 data is ready for estimating spectra. In addition to cleaned and despiked level 1 data channels, level 2 data comprises the additional parameter summarized in the table below.

It is important that the platform speed with respect to water, as used in the dissipation estimates, is included in this level. Also note that the shear probe time series (and optionally acceleration and vibration) must be cleaned and filtered as needed at this level, and will not be altered further when estimating dissipation rates.

On all levels, "sea_water" in the standard name can be replaced by "water" for limnologic applications.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME <math>^a</math> || length of the record from turbulence (fast) data channels
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> At this level platform speed must be provided. We require that this is given at the shear probe time (not TIME_SLOW or TIME_CTD. Please interpolate if needed.
<br>
<math>^b</math> Please use these examples for related sensors, e.g.:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors <br>
N_ACC_SENSORS for vibration acceleration sensors
</div>

=Required Variables=

Pressure? Or more importantly the speed past the sensor
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| SECTION_NUMBER || || dimensionless || TIME
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^a</math> || TIME
|-
| SHEAR || sea_water_velocity_shear || s-1 || [TIME, N_SHEAR_SENSORS]
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME
|}
<math>^a</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 2 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^a</math>, N_ACC_SENSORS]
|}
<math>^a</math> If using TIME_SLOW or TIME_ACC, this must be provided in addition to the TIME record.
</div>

[[Category: Shear probes]]

------
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 1 data (shear probes)| Level 1 data]]<br>
go to next: [[Level 3 data (shear probes)| Level 3 data]].

Level 3 data (shear probes)

2022-09-27T08:44:43Z

PeterHoltermann: /* Required Variables */

Level 3 data contains the raw (and optionally cleaned) [[Spectrum|spectra]] derived from level 2 time series. Level 3 parameters are defined along a new TIME [[Netcdf dimensions (shear probes)|dimension]], which is the average time of the individual spectral segments. The length of the TIME dimension equals the number of spectral segments. Parameter for the calculation of the spectra, e.g. segment length, are provided in the [[Netcdf meta data (shear probes)|meta data]].

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments. This also equals time of dissipation estimates.
|-
| WAVENUMBER || length of the wavenumber array
|-
|N_SHEAR_SENSORS || number of shear channels (shear sensors)
|-
|N_***_SENSORS || number of *** channels (such as ACC and VIB)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^b</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME_SPECTRA
|-
| SH_SPEC || shear_probe_by spectrum || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|-
| KCYC || Cyclic wavenumber || cpm || [TIME_SPECTRA, WAVENUMBER]
|-
| DOF || degrees_of_freedom_of_spectrum || - || 1
|-
| SH_SPEC_CLEAN<math>^a</math>|| shear_probe_spectrum_clean || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|}
<math>^a</math> SH_SPEC_CLEAN must be included in the file if these spectra were used to compute <math>\varepsilon</math>

<math>^b</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 3 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| ACC_SPEC || acceleration_sensor_spectrum || m2 s-4 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS]
|-
| VIB_SPEC || vibration_sensor_spectrum || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS]
|-
| SH_VIB_SPEC ||shear_and_vibration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS*N_SHEAR_SENSORS]
|-
| SH_ACC_SPEC ||shear_and_acceleration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS*N_SHEAR_SENSORS]
|}
</div>

[[Category: Shear probes]]
-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 2 data (shear probes)| Level 2 data]]<br>
go to next: [[Level 4 data (shear probes)| Level 4 data]].

Level 3 data (shear probes)

2022-09-27T08:43:57Z

PeterHoltermann: /* Required Variables */

Level 3 data contains the raw (and optionally cleaned) [[Spectrum|spectra]] derived from level 2 time series. Level 3 parameters are defined along a new TIME [[Netcdf dimensions (shear probes)|dimension]], which is the average time of the individual spectral segments. The length of the TIME dimension equals the number of spectral segments. Parameter for the calculation of the spectra, e.g. segment length, are provided in the [[Netcdf meta data (shear probes)|meta data]].

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments. This also equals time of dissipation estimates.
|-
| WAVENUMBER || length of the wavenumber array
|-
|N_SHEAR_SENSORS || number of shear channels (shear sensors)
|-
|N_***_SENSORS || number of *** channels (such as ACC and VIB)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^b</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME_SPECTRA
|-
| SH_SPEC || shear_probe_by spectrum || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|-
| KCYC || Cyclic wavenumber || cpm || [TIME_SPECTRA, WAVENUMBER]
|-
| DOF || degrees_of_freedom_of_spectrum || - || 1
|-
| SH_SPEC_CLEAN<math>a</math>|| shear_probe_spectrum_clean || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|}
<math>a</math> SH_SPEC_CLEAN must be included in the file if these spectra were used to compute <math>\varepsilon</math>

<math>^b</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 3 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| ACC_SPEC || acceleration_sensor_spectrum || m2 s-4 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS]
|-
| VIB_SPEC || vibration_sensor_spectrum || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS]
|-
| SH_VIB_SPEC ||shear_and_vibration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS*N_SHEAR_SENSORS]
|-
| SH_ACC_SPEC ||shear_and_acceleration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS*N_SHEAR_SENSORS]
|}
</div>

[[Category: Shear probes]]
-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 2 data (shear probes)| Level 2 data]]<br>
go to next: [[Level 4 data (shear probes)| Level 4 data]].

Level 4 data (shear probes)

2022-09-27T08:42:55Z

PeterHoltermann: /* Required Variables */

Level 4 data include the final dissipation estimates as time series, as well as indicators for the quality and accuracy of the estimates and additional derived parameters. Each dissipation estimate in level 4 corresponds to a spectrum in the level 3 data. Consequently, the level 3 and 4 TIME dimensions are the same. Parameter EPSI_FINAL is the final dissipation rate estimate, averaged of the selected estimates (using the [[Quality_control_coding | QC flags]]) at that depth.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments
|-
|N_SHEAR_SENSORS ||number of shear channels (shear sensors)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimensions
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^c</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || flow_past_sensor || m s-1 || TIME_SPECTRA ||
|-
| EPSI || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FINAL || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || TIME_SPECTRA
|-
| KMAX || maximum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FLAGS <math>^a</math> || dissipation_qc_flags || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| METHOD <math>^b</math>|| method_used_for_estimating_ turbulent_kinetic_energy_dissipation || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|}
<math>^a</math> Quality control coding for the final dissipation estimate.

<math>^b</math> METHOD=0 for spectral integration, METHOD=1 for fitting to the inertial subrange.

<math>^c</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 4 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| KVISC || kinematic_viscosity_of_water || m2 s-1 || TIME_SPECTRA
|-
| FOM || figure_of_merit || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| MAD || mean_absolute_deviation || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| VAR_RESOLVED || variance_resolved || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| KMIN || minimum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_STD || expected_standard_deviation_of_the_ logarithm_of_the_dissipation_estimate || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|}

</div>

-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 3 data (shear probes)| Level 3 data]].
[[Category:Shear probes]]

Level 4 data (shear probes)

2022-09-27T08:42:05Z

PeterHoltermann: /* Required Variables */

Level 4 data include the final dissipation estimates as time series, as well as indicators for the quality and accuracy of the estimates and additional derived parameters. Each dissipation estimate in level 4 corresponds to a spectrum in the level 3 data. Consequently, the level 3 and 4 TIME dimensions are the same. Parameter EPSI_FINAL is the final dissipation rate estimate, averaged of the selected estimates (using the [[Quality_control_coding | QC flags]]) at that depth.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments
|-
|N_SHEAR_SENSORS ||number of shear channels (shear sensors)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimensions
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^a</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || flow_past_sensor || m s-1 || TIME_SPECTRA ||
|-
| EPSI || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FINAL || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || TIME_SPECTRA
|-
| KMAX || maximum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FLAGS <math>^a</math> || dissipation_qc_flags || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| METHOD <math>^b</math>|| method_used_for_estimating_ turbulent_kinetic_energy_dissipation || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|}
<math>^a</math> Quality control coding for the final dissipation estimate.

<math>^b</math> METHOD=0 for spectral integration, METHOD=1 for fitting to the inertial subrange.
</div>

=Optional Level 4 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| KVISC || kinematic_viscosity_of_water || m2 s-1 || TIME_SPECTRA
|-
| FOM || figure_of_merit || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| MAD || mean_absolute_deviation || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| VAR_RESOLVED || variance_resolved || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| KMIN || minimum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_STD || expected_standard_deviation_of_the_ logarithm_of_the_dissipation_estimate || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|}

</div>

-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 3 data (shear probes)| Level 3 data]].
[[Category:Shear probes]]

Level 3 data (shear probes)

2022-09-27T08:41:29Z

PeterHoltermann: Time offset

Level 3 data contains the raw (and optionally cleaned) [[Spectrum|spectra]] derived from level 2 time series. Level 3 parameters are defined along a new TIME [[Netcdf dimensions (shear probes)|dimension]], which is the average time of the individual spectral segments. The length of the TIME dimension equals the number of spectral segments. Parameter for the calculation of the spectra, e.g. segment length, are provided in the [[Netcdf meta data (shear probes)|meta data]].

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments. This also equals time of dissipation estimates.
|-
| WAVENUMBER || length of the wavenumber array
|-
|N_SHEAR_SENSORS || number of shear channels (shear sensors)
|-
|N_***_SENSORS || number of *** channels (such as ACC and VIB)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^c</math> || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME_SPECTRA
|-
| SH_SPEC || shear_probe_by spectrum || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|-
| KCYC || Cyclic wavenumber || cpm || [TIME_SPECTRA, WAVENUMBER]
|-
| DOF || degrees_of_freedom_of_spectrum || - || 1
|-
| SH_SPEC_CLEAN<math>\dagger</math>|| shear_probe_spectrum_clean || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|}
</div>
<math>\dagger</math> SH_SPEC_CLEAN must be included in the file if these spectra were used to compute <math>\varepsilon</math>

=Optional Level 3 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| ACC_SPEC || acceleration_sensor_spectrum || m2 s-4 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS]
|-
| VIB_SPEC || vibration_sensor_spectrum || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS]
|-
| SH_VIB_SPEC ||shear_and_vibration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS*N_SHEAR_SENSORS]
|-
| SH_ACC_SPEC ||shear_and_acceleration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS*N_SHEAR_SENSORS]
|}
</div>

[[Category: Shear probes]]
-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 2 data (shear probes)| Level 2 data]]<br>
go to next: [[Level 4 data (shear probes)| Level 4 data]].

Level 2 data (shear probes)

2022-09-27T08:40:42Z

PeterHoltermann: Time offset

Level 2 data are the full resolution, cleaned and despiked parameters from level 1. The initial data set is subdivided in [[Section|sections]] and labeled accordingly in the parameter SECTION_NUMBER with integers. Level 2 data is ready for estimating spectra. In addition to cleaned and despiked level 1 data channels, level 2 data comprises the additional parameter summarized in the table below.

It is important that the platform speed with respect to water, as used in the dissipation estimates, is included in this level. Also note that the shear probe time series (and optionally acceleration and vibration) must be cleaned and filtered as needed at this level, and will not be altered further when estimating dissipation rates.

On all levels, "sea_water" in the standard name can be replaced by "water" for limnologic applications.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME <math>^a</math> || length of the record from turbulence (fast) data channels
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> At this level platform speed must be provided. We require that this is given at the shear probe time (not TIME_SLOW or TIME_CTD. Please interpolate if needed.
<br>
<math>^b</math> Please use these examples for related sensors, e.g.:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors <br>
N_ACC_SENSORS for vibration acceleration sensors
</div>

=Required Variables=

Pressure? Or more importantly the speed past the sensor
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| SECTION_NUMBER || || dimensionless || TIME
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^a</math> || TIME
|-
| SHEAR || sea_water_velocity_shear || s-1 || [TIME, N_SHEAR_SENSORS]
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME
|}
</div>

=Optional Level 2 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^a</math>, N_ACC_SENSORS]
|}
<math>^a</math> If using TIME_SLOW or TIME_ACC, this must be provided in addition to the TIME record.
</div>

[[Category: Shear probes]]

------
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 1 data (shear probes)| Level 1 data]]<br>
go to next: [[Level 3 data (shear probes)| Level 3 data]].

Level 1 data (shear probes)

2022-09-27T08:37:25Z

PeterHoltermann:

Level 1 data refers to the full resolution data in physical units, e.g. the regularly sampled time series of [[Convert the shear probe data|converted shear probe data]]. If needed, a transfer function for shear is given. Below, a table with parameters included in the level 1 data set is compiled. The parameter names and definitions fit the [[NetCDF parameter]] attributes and data is stored as a NetCDF group with the name "L1_converted".

In the standard names, "sea_water" can be replaced with "water" if working in freshwater environments. This is specified in some entries below but not all.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME || length of the record from turbulence (fast) data channels
|-
| TIME_*** <math>^a</math> || length of the record from the *** sensor (e.g., CTD or SLOW)
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> Typically we assume TIME for the fast-sampled microstructure channels, and for example, _SLOW or _CTD for slower sampled channels such as CTD and tilt sensors. If the application requires different time stamps for different sensors, this can be utilized like TIME_PITCH, TIME_ACC etc.
<br>
<math>^b</math> Please use these examples for related sensors:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors, <br>
N_ACC_SENSORS for vibration acceleration sensors, <br>
N_GRADT_SENSORS for thermistors, <br>
N_GRADC_SENSORS for microconductivity sensors. <br>
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || [http://cfconventions.org/cf-conventions/cf-conventions#time-coordinate CF-Conventions compatible offset]<math>^c</math> || TIME
|-
| SHEAR || sea_water_velocity_shear<br /> (or water_velocity_shear) || s-1 || [TIME, N_SHEAR_SENSORS]
|}
<math>^c</math> i.e. "Days since YYYY-MM-DDT00:00:00Z"
</div>

=Optional Level 1 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME <math>^a</math>
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^b</math>, N_ACC_SENSORS]
|-
| TEMP || sea_water_temperature<br /> (water_temperature) || degree_Celsius || [TIME_CTD <math>^b</math>, N_T_SENSORS]
|-
| CNCD || sea_water_electrical_conductivity<br /> (water_electrical_conductivity) || S m-1 || [TIME_CTD <math>^b</math>, N_C_SENSORS]
|-
| GRADT || temperature_gradient || || [TIME, N_GRADT_SENSORS]
|-
| GRADC || conductivity_gradient || || [TIME, N_GRADC_SENSORS]
|-
| PITCH || platform_pitch_angle || degree || TIME <math>^a</math>
|-
| ROLL || platform_roll_angle || degree || TIME <math>^a</math>
|}
<math>^a</math> or TIME_SLOW or TIME_CTD
<br><math>^b</math> or TIME_SLOW
</div>

------
return to [[Dataset requirements for shear probes]] <br>
go to next: [[Level 2 data (shear probes)| Level 2 data]].

[[Category: Shear probes]]

Level 1 data (shear probes)

2022-09-27T08:28:48Z

PeterHoltermann:

Level 1 data refers to the full resolution data in physical units, e.g. the regularly sampled time series of [[Convert the shear probe data|converted shear probe data]]. If needed, a transfer function for shear is given. Below, a table with parameters included in the level 1 data set is compiled. The parameter names and definitions fit the [[NetCDF parameter]] attributes and data is stored as a NetCDF group with the name "L1_converted".

In the standard names, "sea_water" can be replaced with "water" if working in freshwater environments. This is specified in some entries below but not all.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME || length of the record from turbulence (fast) data channels
|-
| TIME_*** <math>^a</math> || length of the record from the *** sensor (e.g., CTD or SLOW)
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> Typically we assume TIME for the fast-sampled microstructure channels, and for example, _SLOW or _CTD for slower sampled channels such as CTD and tilt sensors. If the application requires different time stamps for different sensors, this can be utilized like TIME_PITCH, TIME_ACC etc.
<br>
<math>^b</math> Please use these examples for related sensors:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors, <br>
N_ACC_SENSORS for vibration acceleration sensors, <br>
N_GRADT_SENSORS for thermistors, <br>
N_GRADC_SENSORS for microconductivity sensors. <br>
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || Days since YYYY-MM-DDT00:00:00Z || TIME
|-
| SHEAR || sea_water_velocity_shear<br /> (or water_velocity_shear) || s-1 || [TIME, N_SHEAR_SENSORS]
|}
</div>

=Optional Level 1 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME <math>^a</math>
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^b</math>, N_ACC_SENSORS]
|-
| TEMP || sea_water_temperature<br /> (water_temperature) || degree_Celsius || [TIME_CTD <math>^b</math>, N_T_SENSORS]
|-
| CNCD || sea_water_electrical_conductivity<br /> (water_electrical_conductivity) || S m-1 || [TIME_CTD <math>^b</math>, N_C_SENSORS]
|-
| GRADT || temperature_gradient || || [TIME, N_GRADT_SENSORS]
|-
| GRADC || conductivity_gradient || || [TIME, N_GRADC_SENSORS]
|-
| PITCH || platform_pitch_angle || degree || TIME <math>^a</math>
|-
| ROLL || platform_roll_angle || degree || TIME <math>^a</math>
|}
<math>^a</math> or TIME_SLOW or TIME_CTD
<br><math>^b</math> or TIME_SLOW
</div>

------
return to [[Dataset requirements for shear probes]] <br>
go to next: [[Level 2 data (shear probes)| Level 2 data]].

[[Category: Shear probes]]

Dataset requirements for shear probes

2022-09-27T08:23:39Z

PeterHoltermann: /* Shear probe measurements: Data Format */

This page provides an overview of the NetCDF format of benchmark dataset for instruments that measure microstructure shear using airfoil probes. The data format recommended is summarized in [[#Shear probe measurements: Data Format|Data Format]] below.
<br>
Please use the following naming convention for [[Netcdf dimensions (shear probes)|standard dimensions]] and include the necessary [[Netcdf meta data (shear probes)|meta data]].

* [[Netcdf meta data (shear probes)|list of meta data]]
* [[Netcdf dimensions (shear probes)|list of dimension names]]
* [[Quality_control_coding|quality control coding for dissipation estimates]]

ATOMIX provides several [[Tentative benchmarks for shear probes|benchmark data sets]] following these guidelines.

= Minimum and desirable data set =
<div class="mw-collapsible" id="dataset" data-collapsetext="Collapse" data-expandtext="Expand">

* The absolute minimum signals and information required to estimate the rate of dissipation of kinetic energy consists of:

:* a sampled shear-probe signal,
:* a means of determining the speed of flow past the shear probe, and
:* a means to estimate the temperature of the fluid so that you can determine its kinematic viscosity.

The sampling rate of the shear-probe signal should exceed significantly (by a factor of 2 to 4) the value of 150U, where
U is the speed of the flow past the shear-probe. This speed is often called the speed of profiling, even when the probe is fixed in space and the current causes fluid to flow past the shear probe. The value of 150 cpm equals the spatial resolution of the commonly used shear probe.

* The desirable data set

A far more desirable, but not absolutely necessary, set of data consists of the following.

:* Two or more shear probes for measurement redundancy.
:* Vibration sensors or accelerometers that are sensitive to the directions of sensitivity of the shear probes.
:* An accurate thermometer.
:* A pressure transducer.
:* A signal that can be used to estimate the speed of flow past the shear probe.
:* Pitch and roll sensors.

Most commonly available instruments carry two shear probes that are frequently oriented so that they measure orthogonal components of the shear and, thus, provide two independent estimates of the rate of dissipation that you should agree statistically.
</div>

= Shear probe measurements: Data Format =

Following the recommendations of the [[Flow chart for shear probes | flow chart]], ATOMIX defined four processing levels a user needs to follow to obtain a standardized estimation of epsilon. The different levels are stored as groups in the NetCDF file, the group names are in brackets:

# [[Level 1 data (shear probes)|Raw timeseries (L1_converted)]]
#* full resolution data in physical units
# [[Level 2 data (shear probes)|Quality-controlled and segmented timeseries (L2_cleaned)]]
#* full resolution cleaned and despiked parameters from level 1, subdivided in individual [[Section|sections]].
# [[Level 3 data (shear probes)|Spectra (L3_spectra)]]
#* raw and cleaned spectra
# [[Level 4 data (shear probes)|Dissipation <math>\varepsilon</math> estimates (L4_dissipation)]]
#* dissipation estimates and corresponding quality parameter as time series

-------------------
return to [[Shear probes]]

[[Category:Shear probes]]

Talk:Level 1 data (shear probes)

2022-08-31T06:36:10Z

PeterHoltermann: /* Group names */ new section

I think we should add water_pressure variable as Optional Level 1 variable here as well. We need it to determine average pressure of spectra in L3 and in L4 later.

== Group names ==

The text should mention how the groups are named, are these names the accepted ones?

* L1_converted
* L2_cleaned
* L3_spectra
* L4_dissipation
* L5_final

Level 4 data (shear probes)

2022-06-27T21:56:44Z

PeterHoltermann:

Level 4 data include the final dissipation estimates as time series, as well as indicators for the quality and accuracy of the estimates and additional derived parameters. Each dissipation estimate in level 4 corresponds to a spectrum in the level 3 data. Consequently, the level 3 and 4 TIME dimensions are the same. Parameter EPSI_FINAL is the final dissipation rate estimate, averaged of the selected estimates (using the [[Quality_control_coding | QC flags]]) at that depth.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments
|-
|N_SHEAR_SENSORS ||number of shear channels (shear sensors)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimensions
|-
| TIME || time || Days since YYYY-MM-DDT00:00:00Z || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || flow_past_sensor || m s-1 || TIME_SPECTRA ||
|-
| EPSI || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FINAL || specific_turbulent_kinetic_energy_dissipation_in_water || W kg-1 || TIME_SPECTRA
|-
| KMAX || maximum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_FLAGS <math>^a</math> || dissipation_qc_flags || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| METHOD <math>^b</math>|| method_used_for_estimating_ turbulent_kinetic_energy_dissipation || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|}
<math>^a</math> Quality control coding for the final dissipation estimate.

<math>^b</math> METHOD=0 for spectral integration, METHOD=1 for fitting to the inertial subrange.
</div>

=Optional Level 4 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| KVISC || kinematic_viscosity_of_water || m2 s-1 || TIME_SPECTRA
|-
| FOM || figure_of_merit || - || [TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| MAD || mean_absolute_deviation || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| VAR_RESOLVED || variance_resolved || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| KMIN || minimum_wavenumber_used_for_estimating_ turbulent_kinetic_energy_dissipation || cpm ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|-
| EPSI_STD || expected_standard_deviation_of_the_ logarithm_of_the_dissipation_estimate || - ||[TIME_SPECTRA, N_SHEAR_SENSORS]
|}

</div>

-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 3 data (shear probes)| Level 3 data]].
[[Category:Shear probes]]

Level 3 data (shear probes)

2022-06-27T21:55:51Z

PeterHoltermann:

Level 3 data contains the raw (and optionally cleaned) [[Spectrum|spectra]] derived from level 2 time series. Level 3 parameters are defined along a new TIME [[Netcdf dimensions (shear probes)|dimension]], which is the average time of the individual spectral segments. The length of the TIME dimension equals the number of spectral segments. Parameter for the calculation of the spectra, e.g. segment length, are provided in the [[Netcdf meta data (shear probes)|meta data]].

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>

{| class="wikitable sortable"
! Dimension name !! description
|-
| TIME_SPECTRA || length of the record of average times of spectral segments. This also equals time of dissipation estimates.
|-
| WAVENUMBER || length of the wavenumber array
|-
|N_SHEAR_SENSORS || number of shear channels (shear sensors)
|-
|N_***_SENSORS || number of *** channels (such as ACC and VIB)
|}
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| TIME || time || Days since YYYY-MM-DDT00:00:00Z || TIME_SPECTRA
|-
| SECTION_NUMBER || || - || TIME_SPECTRA
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME_SPECTRA
|-
| SH_SPEC || shear_probe_spectrum || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|-
| KCYC || Cyclic wavenumber || cpm || [TIME_SPECTRA, WAVENUMBER]
|-
| DOF || degrees_of_freedom_of_spectrum || - || 1
|}
</div>

=Optional Level 3 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || water_pressure || dbar || TIME_SPECTRA
|-
| SH_SPEC_CLEAN || shear_probe_spectrum_clean || s-2 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_SHEAR_SENSORS]
|-
| ACC_SPEC || acceleration_sensor_spectrum || m2 s-4 cpm-1 || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS]
|-
| VIB_SPEC || vibration_sensor_spectrum || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS]
|-
| SH_VIB_SPEC ||shear_and_vibration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_VIB_SENSORS*N_SHEAR_SENSORS]
|-
| SH_ACC_SPEC ||shear_and_acceleration_cross-spectral_matrix || - || [TIME_SPECTRA, WAVENUMBER, N_ACCEL_SENSORS*N_SHEAR_SENSORS]
|}
</div>

[[Category: Shear probes]]
-----
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 2 data (shear probes)| Level 2 data]]<br>
go to next: [[Level 4 data (shear probes)| Level 4 data]].

Level 2 data (shear probes)

2022-06-27T21:54:44Z

PeterHoltermann:

Level 2 data are the full resolution, cleaned and despiked parameters from level 1. The initial data set is subdivided in [[Section|sections]] and labeled accordingly in the parameter SECTION_NUMBER with integers. Level 2 data is ready for estimating spectra. In addition to cleaned and despiked level 1 data channels, level 2 data comprises the additional parameter summarized in the table below.

It is important that the platform speed with respect to water, as used in the dissipation estimates, is included in this level. Also note that the shear probe time series (and optionally acceleration and vibration) must be cleaned and filtered as needed at this level, and will not be altered further when estimating dissipation rates.

On all levels, "sea_water" in the standard name can be replaced by "water" for limnologic applications.

=Dimensions=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
! Dimension short name !! description
|-
| TIME <math>^a</math> || length of the record from turbulence (fast) data channels
|-
|N_SHEAR_SENSORS ||number of shear channel (shear sensors)
|-
|N_***_SENSORS <math>^b</math> ||number of *** channel (sensors)
|-
|}
<math>^a</math> At this level platform speed must be provided. We require that this is given at the shear probe time (not TIME_SLOW or TIME_CTD. Please interpolate if needed.
<br>
<math>^b</math> Please use these examples for related sensors, e.g.:<br>
N_VIB_SENSORS for vibration (piezo-acceleration) sensors <br>
N_ACC_SENSORS for vibration acceleration sensors
</div>

=Required Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| SECTION_NUMBER || || dimensionless || TIME
|-
| TIME || time || Days since YYYY-MM-DDT00:00:00Z || TIME
|-
| SHEAR || sea_water_velocity_shear || s-1 || [TIME, N_SHEAR_SENSORS]
|-
| PSPD_REL || platform_speed_wrt_sea_water || m s-1 || TIME
|}
</div>

=Optional Level 2 Variables=
<div class="mw-collapsible mw-expand" data-collapsetext="Collapse" data-expandtext="Expand">
<br>
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| VIB || platform_vibration || NA || [TIME, N_VIB_SENSORS]
|-
| ACC || platform_acceleration || m s-2 || [TIME <math>^a</math>, N_ACC_SENSORS]
|}
<math>^a</math> If using TIME_SLOW or TIME_ACC, this must be provided in addition to the TIME record.
</div>

[[Category: Shear probes]]

------
Return [[Dataset requirements for shear probes]]<br>
go to previous: [[Level 1 data (shear probes)| Level 1 data]]<br>
go to next: [[Level 3 data (shear probes)| Level 3 data]].

Tentative benchmarks for shear probes

2022-06-01T08:25:39Z

PeterHoltermann:

Please follow the [[Filename convention for testing]] if changing the filename prefix supplied in this table.

==File name when testing==
FilenamePrefix_II_YYYYMMDD.nc
where:
* II is your initials (use as many letters as needed)
* YYYYMMDD is the year, month and date using the ISO standard date.

'''The table should include only prefix, not the full testing filename'''
{| class="wikitable sortable"
|-
! Filename Prefix
! Platform
! Instrument
! Region
! PI (ATOMIX)
! Comment
! Volunteer testers
|-
| VMP250_TidalChannel_024_cs
| Ship
| VMP-250
| Haro Strait
| Lueck
| Intense turbulence. | Large up/down drafts affecting fall rate; this one processed using a constant speed of <math>0.75\, \mathrm{m\,s^{-1}}</math>; some estimates require fitting to the inertial subrange.
|
|-
| VMP250_TidalChannel_024
| Ship
| VMP-250
| Haro Strait
| Lueck
| Intense turbulence. | Large up/down drafts affecting fall rate; this one processed using a speed equal to <math>\mathrm{d}P/\mathrm{d}t</math>; some estimates require fitting to the inertial subrange.
| Bluteau
|-
| FLOAT_MR_KY1310_Kuroshio
| Float
| Micro-Rider 1000
| Kuroshio
| Inoue
| Low epsilon with slow speeds past the sensor, NAVIS float.
| Bluteau
|-
| VMP250_KZN_AgulhasCurrent_048
| Ship
| VMP-250
| Agulhas Current
| Lueck
| Moderately intense turbulence. Two sections: one good, the other has descent glitches
| Holtermann
|-
| CPF_MR1000_Monterey_Bay_19_8
| Uprising float
| MR-1000
| Monterey Bay
| Lueck
| Example of a float rising at <math>0.20\,\mathrm{m\,s^{-1}}</math>; some wave orbital interference.
| Fer
|-
| mCTD_VL_StJohns_River_070
| Small boat
| mCTD
| St. Jons River, Florida
| Lueck
| Example of multiple shallow profiles in an estuary.
| Le Boyer
|-
| MicroCTD_UQAM_Malaysia_047_10
| Small boat
| mCTD
| Freshwater reservoir in Malaysia
| Lueck
| Example of poor data that looks good in a vertical profile of shear.
| Le Boyer
|-
| VMP2000_Test_HaroStrait
| Small ship
| VMP-2000
| Haro Strait, tidal channel
| Lueck
| Example of profiler with several narrow banded vibrations.
| Le Boyer
|-
| EPSILOMETER_RockallTrough
| Ship
| Epsilometer
| Rockall Trough
| Le Boyer
| Strong turbulence in a canyon
| Lueck, Bluteau, Ilker
|-
| AUV_MicroRider_BarentsSea
| AUV
| MicroRider
| Barents Sea (Arctic)
| Fer
| Propelled vehicle
| Dengler,Le Boyer
|-
| Glider_MicroRider_BarentsSea
| Glider
| MicroRider
| Barents Sea (Arctic)
| Fer
|
| Dengler
|-
| VMP6000_OgasawaraRidge
| Ship
| VMP-6000
| Ogasawara Ridge (western Pacific)
| Hibiya
| Untethered; >3000 m profile
| Lueck
|-
| Glider_MicroRider_Shelf_Peru
| Glider
| MicroRider<br />
| Continental slope off Peru, eastern tropical Pacific
| Dengler
| Electromagnetic current meter; strong tidal currents
| Le Boyer
|-
| MSS_BalticSea
| Ship
| MSS
| Baltic Sea
| Holtermann
| One good profile, one corrupted by jellyfish
| Bluteau, Fer
|-
| MSS_ArcticOcean
| Ice
| MSS
| Arctic Ocean
| Meyer
|
| Lueck
|-
| VMP6000_NorwegianSea
| Ship
| VMP-6000
| Norwegian Sea
| Fer
| In a strong & deep anticyclone, full depth (>3000 m)
| Bluteau, Inoue
|-
| Ice_VMP250upriser_ArcticOcean
| Ice
| VMP-250 upriser
| Arctic Ocean
| Fer
| One good and bad profile to highlight challenges with an upriser
| Bluteau
|-
| Nemo_MR1000_Minas_Passage_InStream
| Mooring
| MicroRider
| Minas Passage (Bay of Fundy, NS)
| Lueck
| a swift tidal channel. Dissipation estimated from the inertial subrange
| Fer, Bluteau
|}

[[Category: Shear probes]]

-------------------------
return to [[Shear probes]]