Processing your ADCP data using structure function techniques: Difference between revisions

From Atomix
No edit summary
Cleaned up math and tried to simplify the steps
Line 1: Line 1:
To calculate the dissipation rate at a specific range bin:
To calculate the dissipation rate at a specific range bin and a specific time ensemble:
# Extract or compute the [[along-beam bin center separation]] [<math>r_0</math>] based on the instrument geometry
# Extract or compute the [[along-beam bin center separation]] [<math>r_0</math>] based on the instrument geometry
# Calculate the [[along-beam velocity fluctuation]] time-series in each bin, [<math>v’(n, t)</math>] from the along-beam velocity data that has met the QC criteria (i.e. the data in Level 2 of the netcdf file)
# Calculate the [[along-beam velocity fluctuation]] time-series in each bin, [<math>v’(n, t)</math>] from the along-beam velocity data that has met the QC criteria (i.e. the data in Level 2 of the netcdf file)
# Select the maximum distance (<math>r_{max}</math>) over which to compute the structure function based on conditions of the flow (e.g., expected max overturn). The corresponding number of bins are [<math>n_{max} = r_{max} / \delta r_0</math>], where <math>\delta r_{0}</math> is the radial separation between bins.
# Select the maximum distance (<math>r_{max}</math>) over which to compute the structure function based on conditions of the flow (e.g., expected max overturn). The corresponding number of bins are [<math>n_{max} = r_{max} / \delta r_0</math>], where <math>\delta r_{0}</math> is the radial separation between bins.
# The structure function for a data segment can be calculated using either a [[bin-centred difference scheme]] or a [[forward-difference]] scheme
# Calculate the structure function <math>D</math> for all possible bin separations <math>\delta</math> using either a [[bin-centred difference scheme]] or a [[forward-difference]] scheme. Some things to consider are: [SHOULD WE NEED TO INCLUDE THESE HERE?]
# Including D(n, <math>\delta</math>) for <math>\delta</math> = 1 may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated
#* Including <math>D(n,\delta)</math> for <math>\delta=1</math> may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated
# The number of instances when the squared velocity difference is evaluated for each bin n and separation distance <math>\delta</math>r<sub>0</sub> and their distribution are potential quality control metrics
#* Keep a record of the number of instances when the squared velocity difference is evaluated for each bin <math>n</math> and separation distance <math>\delta r_{0}</math> and their distribution because they are potential quality control metrics
# The impact of additional quality criteria can also be tested e.g. valid data requirements for all intermediate separation distances, so for a forward-difference scheme with n = 2 and <math>\delta</math> = 5, require all data in bins 2 to 7 to meet Level 1 QC requirements for the profile to be included when averaging to calculate D(n, <math>\delta</math>)
#* The impact of additional quality criteria can also be tested e.g. valid data requirements for all intermediate separation distances, so for a forward-difference scheme with <math>n=2</math> and <math>\delta=5</math>, require all data in bins 2 to 7 to meet Level 1 QC requirements for the profile to be included when averaging to calculate <math>D(n,\delta)</math>
# Having calculated the segment D(n, <math>\delta</math>) for the appropriate range of bins and <math>\delta</math>r<sub>0</sub> separation distances, a regression of D(n, <math>\delta</math>) against (<math>\delta</math>r<sub>0</sub>)<sup>2/3</sup> is then undertaken.
# Perform a regression of <math>D(n,\delta)</math> against <math>(\delta r_0)^{2/3}</math> for the appropriate range of bins and <math>\delta</math>r<sub>0</sub> separation distances. [THE FOLLOWING ITEMS ARE CONFUSING. SINCE THIS IS BEST PRACTICE, CAN WE JUST RECOMMEND ONE METHOD?]
## If D(n, <math>\delta</math>) was evaluated using a forward-difference scheme, the regression is done for the combined data from all bins in the selected range, hence the maximum number of D(n, <math>\delta</math>) values for each separation distance will be the number of bins in the range less 1 for <math>\delta</math> = 1, reducing by 1 for each increment in <math>\delta</math>, with the regression ultimately yielding a single  <math>\varepsilon</math> value for the data segment
## If <math>D(n,\delta)</math> was evaluated using a forward-difference scheme, the regression is done for the combined data from all bins in the selected range, hence the maximum number of <math>D(n, \delta)</math> values for each separation distance will be the number of bins in the range less 1 for <math>\delta</math> = 1, reducing by 1 for each increment in <math>\delta</math>, with the regression ultimately yielding a single  <math>\varepsilon</math> value for the data segment  
## If D(n, <math>\delta</math>) was evaluated using a bin-centred difference scheme, the regression can either be done:
## If <math>D(n,\delta)</math> was evaluated using a bin-centred difference scheme, the regression can either be done:
### for each bin individually, with a single D(n, <math>\delta</math>) for each separation distance, ultimately yielding an <math>\varepsilon</math> for each bin; or
##* for each bin individually, with a single <math>D(n, \delta)</math> for each separation distance, ultimately yielding an <math>\varepsilon</math> for each bin; or
### by combining the data for all of the bins, with each separation distance having a D(n, <math>\delta</math>) value for each bin, with the regression again ultimately yielding a single <math>\varepsilon</math> value for the data segment
##* by combining the data for all of the bins, with each separation distance having a <math>D(n, \delta)</math> value for each bin, with the regression again ultimately yielding a single <math>\varepsilon</math> value for the data segment
## The regression is typically done as a least-squares fit, either as: <br /><br /> D = a<sub>0</sub> + a<sub>1</sub> (<math>\delta</math>r<sub>0</sub>)<sup>2/3</sup>; or as <br /> D = a<sub>0</sub> + a<sub>1</sub> (<math>\delta</math>r<sub>0</sub>)<sup>2/3</sup> + a<sub>3</sub> ((<math>\delta</math>r<sub>0</sub>)<sup>2/3</sup>)<sup>3</sup> <br /><br /> the former being the canonical approach assuming no non-turbulent velocity difference between bins in v’, whilst the latter seeks to isolate the turbulent contribution from velocity differences between bins due to the orbital velocity forced by surface waves or any residual velocity shear retained due to the oscillatory motion of the ADCP on a mooring, both of which result in a velocity difference between bins which varies linearly with separation distance and hence contributes to D(n, <math>\delta</math>) as (<math>\delta</math>r<sub>0</sub>)<sup>2</sup>
## The regression is typically done as a least-squares fit, either as: <br /><br /> <math>D = a_0 + a_1 (\delta r_0)^{2/3}</math>; or as <br /> <math>D = a_0 + a_1 (\delta r_0)^{2/3}+a_3((\delta r_0)^{2/3})^3 </math> <br /><br /> the former being the [[canonical structure function method | canonical method]] that excludes non-turbulent velocity differences between bins, whereas the latter is a [[modified structure function method | modified method]] that includes non-turbulent velocity differences between bins due to any oscillatory signal (e.g. surface waves, motion of the ADCP on a mooring)
## The coefficient a<sub>0</sub> (the intercept of the regression) is a function of with the noise of the velocity observations
# Use the coefficient <math>a_1</math> to calculate <math>\varepsilon</math> as <br /><br /> <math>\varepsilon = \left(\frac{a_1}{C_2}\right)^{2/3}</math> <br /><br /> where <math>C_2</math> is an empirical constant, typically taken as 2.0 or 2.1 [LINK TO A CONCEPTS OR FUNDAMENTALS PAGE ABOUT THIS].
## The coefficient a<sub>1</sub> is then used to calculate <math>\varepsilon</math> as <br /><br /> <math>\varepsilon</math> = (a<sub>1</sub> / C<sub>2</sub>)<sup>2/3</sup> <br /><br /> where C<sub>2</sub> is an empirical constant, typically taken as 2.0 or 2.1
# Use the coefficient <math>a_1</math> (the intercept of the regression) to estimate the noise of the velocity observations and compare to the expected value based on the instrument settings. [MOVE TO QA2 STEPS?]
 


Return to [[ADCP structure function flow chart| ADCP Flow Chart front page]]
Return to [[ADCP structure function flow chart| ADCP Flow Chart front page]]

Revision as of 02:53, 11 November 2021

To calculate the dissipation rate at a specific range bin and a specific time ensemble:

  1. Extract or compute the along-beam bin center separation [[math]\displaystyle{ r_0 }[/math]] based on the instrument geometry
  2. Calculate the along-beam velocity fluctuation time-series in each bin, [[math]\displaystyle{ v’(n, t) }[/math]] from the along-beam velocity data that has met the QC criteria (i.e. the data in Level 2 of the netcdf file)
  3. Select the maximum distance ([math]\displaystyle{ r_{max} }[/math]) over which to compute the structure function based on conditions of the flow (e.g., expected max overturn). The corresponding number of bins are [[math]\displaystyle{ n_{max} = r_{max} / \delta r_0 }[/math]], where [math]\displaystyle{ \delta r_{0} }[/math] is the radial separation between bins.
  4. Calculate the structure function [math]\displaystyle{ D }[/math] for all possible bin separations [math]\displaystyle{ \delta }[/math] using either a bin-centred difference scheme or a forward-difference scheme. Some things to consider are: [SHOULD WE NEED TO INCLUDE THESE HERE?]
    • Including [math]\displaystyle{ D(n,\delta) }[/math] for [math]\displaystyle{ \delta=1 }[/math] may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated
    • Keep a record of the number of instances when the squared velocity difference is evaluated for each bin [math]\displaystyle{ n }[/math] and separation distance [math]\displaystyle{ \delta r_{0} }[/math] and their distribution because they are potential quality control metrics
    • The impact of additional quality criteria can also be tested e.g. valid data requirements for all intermediate separation distances, so for a forward-difference scheme with [math]\displaystyle{ n=2 }[/math] and [math]\displaystyle{ \delta=5 }[/math], require all data in bins 2 to 7 to meet Level 1 QC requirements for the profile to be included when averaging to calculate [math]\displaystyle{ D(n,\delta) }[/math]
  5. Perform a regression of [math]\displaystyle{ D(n,\delta) }[/math] against [math]\displaystyle{ (\delta r_0)^{2/3} }[/math] for the appropriate range of bins and [math]\displaystyle{ \delta }[/math]r0 separation distances. [THE FOLLOWING ITEMS ARE CONFUSING. SINCE THIS IS BEST PRACTICE, CAN WE JUST RECOMMEND ONE METHOD?]
    1. If [math]\displaystyle{ D(n,\delta) }[/math] was evaluated using a forward-difference scheme, the regression is done for the combined data from all bins in the selected range, hence the maximum number of [math]\displaystyle{ D(n, \delta) }[/math] values for each separation distance will be the number of bins in the range less 1 for [math]\displaystyle{ \delta }[/math] = 1, reducing by 1 for each increment in [math]\displaystyle{ \delta }[/math], with the regression ultimately yielding a single [math]\displaystyle{ \varepsilon }[/math] value for the data segment
    2. If [math]\displaystyle{ D(n,\delta) }[/math] was evaluated using a bin-centred difference scheme, the regression can either be done:
      • for each bin individually, with a single [math]\displaystyle{ D(n, \delta) }[/math] for each separation distance, ultimately yielding an [math]\displaystyle{ \varepsilon }[/math] for each bin; or
      • by combining the data for all of the bins, with each separation distance having a [math]\displaystyle{ D(n, \delta) }[/math] value for each bin, with the regression again ultimately yielding a single [math]\displaystyle{ \varepsilon }[/math] value for the data segment
    3. The regression is typically done as a least-squares fit, either as:

      [math]\displaystyle{ D = a_0 + a_1 (\delta r_0)^{2/3} }[/math]; or as
      [math]\displaystyle{ D = a_0 + a_1 (\delta r_0)^{2/3}+a_3((\delta r_0)^{2/3})^3 }[/math]

      the former being the canonical method that excludes non-turbulent velocity differences between bins, whereas the latter is a modified method that includes non-turbulent velocity differences between bins due to any oscillatory signal (e.g. surface waves, motion of the ADCP on a mooring).
  6. Use the coefficient [math]\displaystyle{ a_1 }[/math] to calculate [math]\displaystyle{ \varepsilon }[/math] as

    [math]\displaystyle{ \varepsilon = \left(\frac{a_1}{C_2}\right)^{2/3} }[/math]

    where [math]\displaystyle{ C_2 }[/math] is an empirical constant, typically taken as 2.0 or 2.1 [LINK TO A CONCEPTS OR FUNDAMENTALS PAGE ABOUT THIS].
  7. Use the coefficient [math]\displaystyle{ a_1 }[/math] (the intercept of the regression) to estimate the noise of the velocity observations and compare to the expected value based on the instrument settings. [MOVE TO QA2 STEPS?]


Return to ADCP Flow Chart front page