Dataset requirements for shear probes: Difference between revisions

From Atomix
Aleboyer (talk | contribs)
No edit summary
 
(24 intermediate revisions by 4 users not shown)
Line 1: Line 1:
__TOC__


== The absolute minimum data set ==
This page provides an overview of the NetCDF format of benchmark dataset for instruments that measure microstructure shear using airfoil probes. The data format recommended is summarized in [[#Shear probe measurements: Data Format|Data Format]] below.
<div class="mw-collapsible mw-collapsed" id="Minimum" data-collapsetext="Collapse" data-expandtext="Expand minimum data set">
<br>
Please use the following naming convention for  [[Netcdf dimensions (shear probes)|standard dimensions]] and include the necessary [[Netcdf meta data (shear probes)|meta data]].


* [[Netcdf meta data (shear probes)|list of meta data]]
* [[Netcdf dimensions (shear probes)|list of dimension names]]
* [[Quality_control_coding|quality control coding for dissipation estimates]]


The absolute minimum signals and information required to estimate the rate of dissipation of kinetic energy consists of:
ATOMIX provides several [[Tentative benchmarks for shear probes|benchmark data sets]] following these guidelines.


* a sampled shear-probe signal, 
= Minimum and desirable data set =
* a means of determining the speed of flow past the shear probe, and
<div class="mw-collapsible" id="dataset" data-collapsetext="Collapse" data-expandtext="Expand">
* a means to estimate the temperature of the fluid so that you can determine its kinematic viscosity. 


The sampling rate of the shear-probe signal should exceed significantly (by a factor of 2 to 4) the value of 150U, where  
 
* The absolute minimum signals and information required to estimate the rate of dissipation of kinetic energy consists of:
 
:* a sampled shear-probe signal, 
:* a means of determining the speed of flow past the shear probe, and 
:* a means to estimate the temperature of the fluid so that you can determine its kinematic viscosity. 
 
In addition, it is highly recommended to have a minimum one vibration sensor or accelerometer that can be used to check and eventually correct for platform vibrations. The sampling rate of the shear-probe signal should exceed significantly (by a factor of 2 to 4) the value of 150U, where  
U is the speed of the flow past the shear-probe. This speed is often called the speed of profiling, even when the probe is fixed in space and the current causes fluid to flow past the shear probe. The value of 150 cpm equals the spatial resolution of the commonly used shear probe.  
U is the speed of the flow past the shear-probe. This speed is often called the speed of profiling, even when the probe is fixed in space and the current causes fluid to flow past the shear probe. The value of 150 cpm equals the spatial resolution of the commonly used shear probe.  


</div>
   
   
== The desirable data set ==
* The desirable data set  
<div class="mw-collapsible mw-collapsed" id="desirable" data-collapsetext="Collapse" data-expandtext="Expand desirable data set">
 


A far more desirable, but not absolutely necessary, set of data consists of the following.  
A far more desirable, but not absolutely necessary, set of data consists of the following.  


* Two or more shear probes for measurement redundancy.   
:* Two or more shear probes for measurement redundancy.   
* Vibration sensors or accelerometers that are sensitive to the directions of sensitivity of the shear probes.   
:* Vibration sensors or accelerometers that are sensitive to the directions of sensitivity of the shear probes.   
* An accurate thermometer.   
:* An accurate thermometer.   
* A pressure transducer.   
:* A pressure transducer.   
* A signal that can be used to estimate the speed of flow past the shear probe.   
:* A signal that can be used to estimate the speed of flow past the shear probe.   
* Pitch and roll sensors.  
:* Pitch and roll sensors.  


Most commonly available instruments carry two shear probes that are frequently oriented so that they measure orthogonal components of the shear and, thus, provide two independent estimates of the rate of dissipation that you should agree statistically.
Most commonly available instruments carry two shear probes that are frequently oriented so that they measure orthogonal components of the shear and, thus, provide two independent estimates of the rate of dissipation that you should agree statistically.
</div>
</div>


== Recommended data format ==
<div class="mw-collapsible mw-collapsed" id="Recommended" data-collapsetext="Collapse" data-expandtext="Expand data format">


For sharing a data set, we recommend providing four processing levels of data in a single netCDF file per instrument file. The processing levels include
= Shear probe measurements: Data Format =


* L1_converted ([[Level 1 data (shear probes)|level 1]])
Following the recommendations of the [[Flow chart for shear probes | flow chart]], ATOMIX defined four processing levels a user needs to follow to obtain a standardized estimation of epsilon. The different levels are stored as groups in the NetCDF file, the group names are in brackets:
* L2_cleaned ([[Level 2 data (shear probes)|level 2]])
* L3_spectra ([[Level 3 data (shear probes)|level 3]])
* L4_dissipation ([[Level 4 data (shear probes)|level 4]])
* Ancillary
The data format recommended is summarized in [[Netcdf dimensions (shear probes)|standard dimensions]] and should include necessary [[Netcdf meta data (shear probes)|meta data]]. ATOMIX provides several [[Benchmark datasets for shear probes|benchmark data sets]] following these guidelines.


# [[Level 1 data (shear probes)|Timeseries in physical units (L1_converted)]]
#* full resolution data in physical units
# [[Level 2 data (shear probes)|Quality-controlled and segmented timeseries (L2_cleaned)]]
#* full resolution cleaned and despiked parameters from level 1, subdivided in individual [[Section|sections]].
# [[Level 3 data (shear probes)|Spectra (L3_spectra)]]
#* raw and cleaned spectra
# [[Level 4 data (shear probes)|Dissipation <math>\varepsilon</math> estimates (L4_dissipation)]]
#* dissipation estimates and corresponding quality parameter as time series


This section provides an overview of the NetCDF format of benchmark dataset for instruments that measure microstructure shear.
-------------------
 
return to [[Shear probes]]
=== Raw timeseries ===
<div class="mw-collapsible mw-collapsed" id="raw" data-collapsetext="Collapse" data-expandtext="Expand Raw">


===Dimensions===
'''Example of collapsible list'''
<ul class="mw-collapsible">
  <li>TIME</li>
  <li>HEIGHT_AS</li>
</ul>


 
[[Category:Shear probes]]
'''Example of collapsible table'''
{| class="wikitable sortable mw-collapsible"
! Short name
! Standard name
|-
| TIME
| days since 1950-01-01 00:00:00 UTC
|-
|n_shear_sensors
|number of shear channel
|-
|}
 
 
{| class="wikitable sortable mw-collapsible"
|+ These dimensions are defined for the raw group level but have a caption.
! Short name
! Standard name
|-
| Content
| Goes
|-
| In Here
| Please
|}
 
===Required Variables===
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| PRES || sea_water_pressure<br /> water_pressure || dbar || TIME || 1,2
|-
| TIME || time || days since 1950-01-01 00:00:00 UTC || TIME || 1
|-
| SHEAR || water_velocity_shear || s-1 || [TIME, n_shear_sensors] || 1
|}
 
===Optional Variables===
{| class="wikitable sortable"
|-
! Parameter Name !! Standard Name !! Units of measurement !! dimension
|-
| VIB || platform_vibration || NA || [TIME, n_vibration_sensors]
|-
| ACC || platform_acceleration || m s-2 || [TIME, n_acc_sensors]
|-
| TEMP || sea_water_temperature<br /> (water_temperature) || degree_Celsius || [TIME,n_T_sensors]
|-
| CNCD || sea_water_electrical_conductivity<br /> (water_electrical_conductivity) || S m-1 || [TIME_FAST,n_C_sensors]
|-
| GRADT || temperature_gradient ||  || [TIME, n_gradT_sensors]
|-
| GRADC || conductivity_gradient || || [TIME, n_gradC_sensors]
|-
| PITCH || platform_pitch_angle || degree || [TIME]
|-
| ROLL || platform_roll_angle || degree || [TIME]
|}
 
 
 
===Group Attributes (metadata)===
<div class="mw-collapsible"  id="raw_att"  data-expandtext="Expand Raw Attributes" data-collapsetext="Collapse attributes">
=Required=
<ul>
  <li>Att 1</li>
  <li>Att2</li>
</ul>
 
=Optional =
<ul>
<li>Enter here</li>
</ul>
</div>
 
</div>
 
===Quality-controlled and segmented timeseries===
<div class="mw-collapsible mw-collapsed" id="segmented" data-collapsetext="Collapse" data-expandtext="Expand QAQC timeseries">
 
Insert info here in the same format as [[#raw|Raw]]
</div>
 
===Spectra===
<div class="mw-collapsible mw-collapsed" id="spectra" data-collapsetext="Collapse" data-expandtext="Expand Spectra">
 
</div>
 
===Dissipation===
<div class="mw-collapsible mw-collapsed" id="dissipation" data-collapsetext="Collapse" data-expandtext="Expand Dissipation">
 
</div>
 
 
-------------------
return to [[Shear probes]]

Latest revision as of 15:59, 9 September 2023

This page provides an overview of the NetCDF format of benchmark dataset for instruments that measure microstructure shear using airfoil probes. The data format recommended is summarized in Data Format below.
Please use the following naming convention for standard dimensions and include the necessary meta data.

ATOMIX provides several benchmark data sets following these guidelines.

Minimum and desirable data set


  • The absolute minimum signals and information required to estimate the rate of dissipation of kinetic energy consists of:
  • a sampled shear-probe signal,
  • a means of determining the speed of flow past the shear probe, and
  • a means to estimate the temperature of the fluid so that you can determine its kinematic viscosity.

In addition, it is highly recommended to have a minimum one vibration sensor or accelerometer that can be used to check and eventually correct for platform vibrations. The sampling rate of the shear-probe signal should exceed significantly (by a factor of 2 to 4) the value of 150U, where U is the speed of the flow past the shear-probe. This speed is often called the speed of profiling, even when the probe is fixed in space and the current causes fluid to flow past the shear probe. The value of 150 cpm equals the spatial resolution of the commonly used shear probe.


  • The desirable data set

A far more desirable, but not absolutely necessary, set of data consists of the following.

  • Two or more shear probes for measurement redundancy.
  • Vibration sensors or accelerometers that are sensitive to the directions of sensitivity of the shear probes.
  • An accurate thermometer.
  • A pressure transducer.
  • A signal that can be used to estimate the speed of flow past the shear probe.
  • Pitch and roll sensors.

Most commonly available instruments carry two shear probes that are frequently oriented so that they measure orthogonal components of the shear and, thus, provide two independent estimates of the rate of dissipation that you should agree statistically.


Shear probe measurements: Data Format

Following the recommendations of the flow chart, ATOMIX defined four processing levels a user needs to follow to obtain a standardized estimation of epsilon. The different levels are stored as groups in the NetCDF file, the group names are in brackets:

  1. Timeseries in physical units (L1_converted)
    • full resolution data in physical units
  2. Quality-controlled and segmented timeseries (L2_cleaned)
    • full resolution cleaned and despiked parameters from level 1, subdivided in individual sections.
  3. Spectra (L3_spectra)
    • raw and cleaned spectra
  4. Dissipation [math]\displaystyle{ \varepsilon }[/math] estimates (L4_dissipation)
    • dissipation estimates and corresponding quality parameter as time series

return to Shear probes