Processing your ADCP data using structure function techniques: Difference between revisions

From Atomix
Yuengdjern (talk | contribs)
No edit summary
No edit summary
Line 1: Line 1:


# Extract or compute the along-beam distance of the center of each bin [z<sub>b</sub>] and bin center separation [r0]  
# Extract or compute the along-beam bin center separation [r0] based on the instrument geometry
# Calculate the along-beam velocity fluctuations in each bin [v’(z<sub>b</sub>)]  
# Calculate the along-beam velocity fluctuation time-series in each bin, [v’(n, t)] from the Level 1 along-beam velocity data that has met the QC criteria
## If using burst sampling, calculations are done over the length of the burst if stationary
## If using burst sampling, calculations are done over the length of the burst or some sub-period over which the turbulent flow statistics can assumed to be stationary
## If using continuous sampling, a time interval must be selected in which the flow can assumed to be stationary  
## If using continuous sampling, calculations are dome over segments with a duration over which the turbulent flow statistics can assumed to be stationary
## You can calculate the fluctuations around:  
## For each data segment consisting of N profiles, the turbulent fluctuations are calculated separately for each beam and bin around either:  
### ''The mean of the time interval''  
##* ''The mean over the data segment''  
### ''A linear detrend of the time interval''  
##* ''A linear detrend of the segment''  
### ''A low pass filtered signal''  
##* ''A low pass filtered signal''
# Select the maximum distance over which to compute the structure function based on conditions of the flow (e.g., expected max overturn) [r<sub>max</sub>]  
# Select the maximum distance over which to compute the structure function based on conditions of the flow (e.g., expected max overturn) [r<sub>max</sub>] in bin separation distances [n<sub>max</sub> = r<sub>max</sub> / r<sub>0</sub>]
# Start at the first bin where z<sub>b</sub> >= r<sub>max</sub>/2  
# The structure function for a data segment can be calculated using either a '''bin-centred difference''' or a '''forward-difference''' scheme
# Compute the centered difference of v’ along the beam for the first pair of bins on either side: v’(z+r<sub>0</sub>)-v’(z-r<sub>0</sub>)
# For a '''bin-centred difference''' scheme
# Compute the second order structure function D(z,r) = mean-square of the velocity fluctuation difference:  D(z,2*r0) = mean(v’(z+r<sub>0</sub>)-v’(z-r<sub>0</sub>))2  
## start at bin n = (n<sub>max</sub> / 2) + 1
# Repeat steps 5-6 for all pairs of bins where the separation distance between bins r <= r<sub>max</sub>  
### start with <math>\delta</math> = 1
### if <math>\delta</math> is '''''even''''' compute the second order structure function D(n,<math>\delta</math>) as the segment mean of the square of the velocity difference between the bins separated by distance <math>\delta</math>r<sub>0</sub> centered around bin n: <br /><br />D(n, <math>\delta</math>) = <math>\langle</math> [v’(n+(<math>\delta</math> / 2), t) - v’(n-(<math>\delta</math> / 2), t)]<sup>2</sup> <math>\rangle</math> <br/><br /> where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria
### if <math>\delta</math> is '''''odd''''' compute the second order structure function D(n,<math>\delta</math>) as the segment mean of the mean of the square of the velocity difference between the bins separated by distance <math>\delta</math>r<sub>0</sub> centered on the upper and lower extent of bin n: <br/><br /> dv'<sub>lo</sub>(n, <math>\delta</math>, t) = v’(n+floor(<math>\delta</math> / 2), t) - v’(n-ceil(<math>\delta</math> / 2), t) <br/> dv'<sub>hi</sub>(n, <math>\delta</math>, t) = v’(n+ceil(<math>\delta</math> / 2), t) - v’(n-floor(<math>\delta</math> / 2), t) <br/><br /> where ''ceil'' and ''floor'' indicate the upper and lower integer value respectively, then <br/><br /> D(n, <math>\delta</math>) = <math>\langle</math> [dv'<sub>lo</sub>(n, <math>\delta</math>, t)<sup>2</sup> + dv'<sub>hi</sub>(n, <math>\delta</math>, t)<sup>2</sup>] / 2 <math>\rangle</math> <br/><br /> the angled brackets again indicating the mean across all t in the data segment yielding a velocity difference after the application of the Level 1 QC criteria
### increment <math>\delta</math> and repeat steps until <math>\delta</math> = n<sub>max</sub>
## increment n and repeat steps until n + (n<sub>max</sub> / 2) exceeds the bin number for which valid v’ are available
# For a '''forward-difference''' scheme
## start with n being the lowest number bin of the range over which the structure function is to be evaluated (number of bins in range must exceed n<sub>max</sub>
### start with <math>\delta</math> = 1
### compute the second order structure function D(n,<math>\delta</math>) as the segment mean of the square of the velocity difference between the bin n and bin n + <math>\delta</math>: <br/><br /> D(n, <math>\delta</math>) = <math>\langle</math> [v’(n, t) - v’(n+<math>\delta</math>, t)]<sup>2</sup> <math>\rangle</math> <br/><br /> where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria
### increment <math>\delta</math> and repeat steps until <math>\delta</math> = n<sub>max</sub> or n + <math>\delta</math> exceeds the last bin of the range over which the structure function is to be evaluated
## increment n and repeat steps until n + 1 is the last bin of the range over which the structure function is to be evaluated
# Including D(n, <math>\delta</math>) for <math>\delta</math> = 1 may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated
# The number of instances when the squared velocity difference is evaluated for each bin n and separation distance <math>\delta</math>r<sub>0</sub> and their distribution are potential quality control metrics
 
'''[IN PROGRESS]'''
## Compute the second order structure function D(z,r) = mean-square of the velocity fluctuation difference:  D(z,2*r0) = mean(v’(z+r<sub>0</sub>)-v’(z-r<sub>0</sub>))<sup>2</sup>
## Repeat steps 5-6 for all pairs of bins where the separation distance between bins r <= r<sub>max</sub>  
# Check if all points involved in the differencing to contain good data, e.g. If I were starting from bin=2, with a maximum separation distance of 5, I required all data in bins 2 to 7 to meet QC requirements (usually just use correlation threshold).  If yes, continue with the next step.  If not, exclude this profile.
# Check if all points involved in the differencing to contain good data, e.g. If I were starting from bin=2, with a maximum separation distance of 5, I required all data in bins 2 to 7 to meet QC requirements (usually just use correlation threshold).  If yes, continue with the next step.  If not, exclude this profile.
# With valid, contiguous data points, fit a line to the form D(z,r) = N + Ar<sup>2</sup>/3 to estimate values for A and N where A = Cv<sup>2</sup>ε<sup>2</sup>/3  and N is an estimate of the uncertainty due to noise.  
# With valid, contiguous data points, fit a line to the form D(z,r) = N + Ar<sup>2</sup>/3 to estimate values for A and N where A = Cv<sup>2</sup>ε<sup>2</sup>/3  and N is an estimate of the uncertainty due to noise.  

Revision as of 17:58, 9 November 2021

  1. Extract or compute the along-beam bin center separation [r0] based on the instrument geometry
  2. Calculate the along-beam velocity fluctuation time-series in each bin, [v’(n, t)] from the Level 1 along-beam velocity data that has met the QC criteria
    1. If using burst sampling, calculations are done over the length of the burst or some sub-period over which the turbulent flow statistics can assumed to be stationary
    2. If using continuous sampling, calculations are dome over segments with a duration over which the turbulent flow statistics can assumed to be stationary
    3. For each data segment consisting of N profiles, the turbulent fluctuations are calculated separately for each beam and bin around either:
      • The mean over the data segment
      • A linear detrend of the segment
      • A low pass filtered signal
  3. Select the maximum distance over which to compute the structure function based on conditions of the flow (e.g., expected max overturn) [rmax] in bin separation distances [nmax = rmax / r0]
  4. The structure function for a data segment can be calculated using either a bin-centred difference or a forward-difference scheme
  5. For a bin-centred difference scheme
    1. start at bin n = (nmax / 2) + 1
      1. start with [math]\displaystyle{ \delta }[/math] = 1
      2. if [math]\displaystyle{ \delta }[/math] is even compute the second order structure function D(n,[math]\displaystyle{ \delta }[/math]) as the segment mean of the square of the velocity difference between the bins separated by distance [math]\displaystyle{ \delta }[/math]r0 centered around bin n:

        D(n, [math]\displaystyle{ \delta }[/math]) = [math]\displaystyle{ \langle }[/math] [v’(n+([math]\displaystyle{ \delta }[/math] / 2), t) - v’(n-([math]\displaystyle{ \delta }[/math] / 2), t)]2 [math]\displaystyle{ \rangle }[/math]

        where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria
      3. if [math]\displaystyle{ \delta }[/math] is odd compute the second order structure function D(n,[math]\displaystyle{ \delta }[/math]) as the segment mean of the mean of the square of the velocity difference between the bins separated by distance [math]\displaystyle{ \delta }[/math]r0 centered on the upper and lower extent of bin n:

        dv'lo(n, [math]\displaystyle{ \delta }[/math], t) = v’(n+floor([math]\displaystyle{ \delta }[/math] / 2), t) - v’(n-ceil([math]\displaystyle{ \delta }[/math] / 2), t)
        dv'hi(n, [math]\displaystyle{ \delta }[/math], t) = v’(n+ceil([math]\displaystyle{ \delta }[/math] / 2), t) - v’(n-floor([math]\displaystyle{ \delta }[/math] / 2), t)

        where ceil and floor indicate the upper and lower integer value respectively, then

        D(n, [math]\displaystyle{ \delta }[/math]) = [math]\displaystyle{ \langle }[/math] [dv'lo(n, [math]\displaystyle{ \delta }[/math], t)2 + dv'hi(n, [math]\displaystyle{ \delta }[/math], t)2] / 2 [math]\displaystyle{ \rangle }[/math]

        the angled brackets again indicating the mean across all t in the data segment yielding a velocity difference after the application of the Level 1 QC criteria
      4. increment [math]\displaystyle{ \delta }[/math] and repeat steps until [math]\displaystyle{ \delta }[/math] = nmax
    2. increment n and repeat steps until n + (nmax / 2) exceeds the bin number for which valid v’ are available
  6. For a forward-difference scheme
    1. start with n being the lowest number bin of the range over which the structure function is to be evaluated (number of bins in range must exceed nmax
      1. start with [math]\displaystyle{ \delta }[/math] = 1
      2. compute the second order structure function D(n,[math]\displaystyle{ \delta }[/math]) as the segment mean of the square of the velocity difference between the bin n and bin n + [math]\displaystyle{ \delta }[/math]:

        D(n, [math]\displaystyle{ \delta }[/math]) = [math]\displaystyle{ \langle }[/math] [v’(n, t) - v’(n+[math]\displaystyle{ \delta }[/math], t)]2 [math]\displaystyle{ \rangle }[/math]

        where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria
      3. increment [math]\displaystyle{ \delta }[/math] and repeat steps until [math]\displaystyle{ \delta }[/math] = nmax or n + [math]\displaystyle{ \delta }[/math] exceeds the last bin of the range over which the structure function is to be evaluated
    2. increment n and repeat steps until n + 1 is the last bin of the range over which the structure function is to be evaluated
  7. Including D(n, [math]\displaystyle{ \delta }[/math]) for [math]\displaystyle{ \delta }[/math] = 1 may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated
  8. The number of instances when the squared velocity difference is evaluated for each bin n and separation distance [math]\displaystyle{ \delta }[/math]r0 and their distribution are potential quality control metrics

[IN PROGRESS]

    1. Compute the second order structure function D(z,r) = mean-square of the velocity fluctuation difference: D(z,2*r0) = mean(v’(z+r0)-v’(z-r0))2
    2. Repeat steps 5-6 for all pairs of bins where the separation distance between bins r <= rmax
  1. Check if all points involved in the differencing to contain good data, e.g. If I were starting from bin=2, with a maximum separation distance of 5, I required all data in bins 2 to 7 to meet QC requirements (usually just use correlation threshold). If yes, continue with the next step. If not, exclude this profile.
  2. With valid, contiguous data points, fit a line to the form D(z,r) = N + Ar2/3 to estimate values for A and N where A = Cv2ε2/3 and N is an estimate of the uncertainty due to noise.
  3. Solve for ε using Cv2 = 2.1
  4. Repeat the steps in (5) – (9) for each bin until zb + rmax/2 >= end of profile

Return to ADCP Flow Chart front page