Level 2 data (velocity profilers)

From Atomix
Revision as of 00:31, 15 January 2022 by CynthiaBluteau (talk | contribs) (Deleting qaqc level 2)

Velocities have now been segmented and detrended. Each segment is stored separately from each other, which accommodates segmenting datasets using an overlapping window i.e., some velocity samples can belong to more than one segment. This processing level is only required when an overlapping window is used during segmenting. For all other cases, the segment number and detrended velocities can be provided in Level 2 qaqc velocities.


Page status: Ready for review
Author(s): Cynthia
Reviewer(s):
Comment:

The dimensions and variables for this optional processing level within NetCDF ATOMIX format are described below. This processing level is only required when an overlapping window is used during segmenting. For all other cases, the segment number and detrended velocities can be provided in Level 2 qaqc velocities.

Only a few attributes for each variable are listed since the page's purpose is to describe the information layout within each NetCDF file. Please refer to the complete list for the additional attributes related to each variable (e.g., units, bounds, cell_methods).

Dimensions


Short name Standard name Dimensions Comments
N_SEGMENT unique_identifier_for_each_

segment_in_the_entire_available_timeseries

N_SEGMENT Replacement for using TIME centred in the segment as dimension
N_SAMPLE unique_identifier_for_each_

sample_within_the_segment

N_SAMPLE Max sample number is the segment length (seconds) multiplied by the sampling rate
N_BEAM unique_identifier_for_each_beam N_BEAM Array of 1 to number of beams (3 to 5 typically)
R_DIST distance_from_sensor_along_beams R_DIST Along-beam bin centre distance (in meters) from the transducer
Optional dimensions for 5-beam ADCP
R_DIST5 distance_from_sensor_along_beam_5 R_DIST5 Along-beam bin centre distance (in meters) from the transducer for the 5th vertical beam

Variables


Short name Standard name Dimensions Comment
R_VEL water_radial_velocity_of_scatterers_

towards_instrument

N_SEGMENT [or time], R_DIST,N_SAMPLE, N_BEAM
R_VEL_DETRENDED water_radial_velocity_of_scatterers_

towards_instrument_detrended

N_SEGMENT, R_DIST, N_SAMPLE, N_BEAM High-frequency content of the signal, which may include surface wave, motion contamination, in addition to the turbulence signal. Please specify how.
TIME TIME N_SEGMENT, N_SAMPLE Units in Days since 1950-01-01T00:00:00Z
BURST_NUMBER [math]\displaystyle{ \dagger\dagger }[/math] unique_identifier_for_each_burst N_SEGMENT, N_SAMPLE Only required when measuring in burst-mode. Integers of 1, 2, etc to designate which burst the velocities are associated with.
Optional dimensions for 5-beam ADCP [math]\displaystyle{ \ddagger }[/math]
R_VEL5 water_radial_velocity_of_scatterers_

towards_instrument_in_beam_5

N_SEGMENT, R_DIST5, N_SAMPLE Only necessary for 5-beam ADCP
R_VEL5_DETRENDED water_radial_velocity_

towards_instrument_in_beam_5_detrended

N_SEGMENT, R_DIST5, N_SAMPLE High-frequency content of the signal, which may include surface wave, motion contamination, in addition to the turbulence signal. Please specify how.

[math]\displaystyle{ \ddagger }[/math] One could re-write for convenience the optional variables in Level 1 after segmenting them into smaller chunks.

[math]\displaystyle{ \dagger\dagger }[/math] Variable required only when measuring in bursts e.g., 18 min of continuous measurements every hour.

Group attributes (metadata)

This section describes attributes that may provide additional information about how the data was processed and manipulated at this stage.


Attribute name Purpose Suggested content
processing_level Boilerplate about the content of the NetCDF group.

In this group, quality-controlled velocities have been split into smaller segments for processing. The timeseries are also detrended to recover the turbulence, and potentially surface wave and motion contamination.

segment_length Provide length in seconds of each segment Usually about 300 to 600 s dependent on time and length scales of turbulence
segment_overlap_proportion Provide proportion overlap of each segment, i.e., window overlap Often set to 0 or 0.5
detrending_method Specify which filter or technique was used to detrend velocities, which is required for spectral and turbulence analysis. Some examples include

High-pass YY order butterworth filter with XX seconds cutoff frequency on the entire burst/timeseries

Linear detrending on each segment

Optional group attributes
comment (optional) Any additional information pertinent to other users who test their algorithms against the file.

Return to: Level 1 raw

Go to Level 3 structure function