Processing your ADCP data using structure function techniques: Difference between revisions
From Atomix
Yuengdjern (talk | contribs) No edit summary |
No edit summary |
||
Line 1: | Line 1: | ||
# Extract or compute the along-beam | # Extract or compute the along-beam bin center separation [r0] based on the instrument geometry | ||
# Calculate the along-beam velocity | # Calculate the along-beam velocity fluctuation time-series in each bin, [v’(n, t)] from the Level 1 along-beam velocity data that has met the QC criteria | ||
## If using burst sampling, calculations are done over the length of the burst | ## If using burst sampling, calculations are done over the length of the burst or some sub-period over which the turbulent flow statistics can assumed to be stationary | ||
## If using continuous sampling, a | ## If using continuous sampling, calculations are dome over segments with a duration over which the turbulent flow statistics can assumed to be stationary | ||
## | ## For each data segment consisting of N profiles, the turbulent fluctuations are calculated separately for each beam and bin around either: | ||
## | ##* ''The mean over the data segment'' | ||
## | ##* ''A linear detrend of the segment'' | ||
## | ##* ''A low pass filtered signal'' | ||
# Select the maximum distance over which to compute the structure function based on conditions of the flow (e.g., expected max overturn) [r<sub>max</sub>] | # Select the maximum distance over which to compute the structure function based on conditions of the flow (e.g., expected max overturn) [r<sub>max</sub>] in bin separation distances [n<sub>max</sub> = r<sub>max</sub> / r<sub>0</sub>] | ||
# | # The structure function for a data segment can be calculated using either a '''bin-centred difference''' or a '''forward-difference''' scheme | ||
# | # For a '''bin-centred difference''' scheme | ||
# Compute the second order structure function D(z,r) = mean-square of the velocity fluctuation difference: D(z,2*r0) = mean(v’(z+r<sub>0</sub>)-v’(z-r<sub>0</sub>))2 | ## start at bin n = (n<sub>max</sub> / 2) + 1 | ||
# Repeat steps 5-6 for all pairs of bins where the separation distance between bins r <= r<sub>max</sub> | ### start with <math>\delta</math> = 1 | ||
### if <math>\delta</math> is '''''even''''' compute the second order structure function D(n,<math>\delta</math>) as the segment mean of the square of the velocity difference between the bins separated by distance <math>\delta</math>r<sub>0</sub> centered around bin n: <br /><br />D(n, <math>\delta</math>) = <math>\langle</math> [v’(n+(<math>\delta</math> / 2), t) - v’(n-(<math>\delta</math> / 2), t)]<sup>2</sup> <math>\rangle</math> <br/><br /> where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria | |||
### if <math>\delta</math> is '''''odd''''' compute the second order structure function D(n,<math>\delta</math>) as the segment mean of the mean of the square of the velocity difference between the bins separated by distance <math>\delta</math>r<sub>0</sub> centered on the upper and lower extent of bin n: <br/><br /> dv'<sub>lo</sub>(n, <math>\delta</math>, t) = v’(n+floor(<math>\delta</math> / 2), t) - v’(n-ceil(<math>\delta</math> / 2), t) <br/> dv'<sub>hi</sub>(n, <math>\delta</math>, t) = v’(n+ceil(<math>\delta</math> / 2), t) - v’(n-floor(<math>\delta</math> / 2), t) <br/><br /> where ''ceil'' and ''floor'' indicate the upper and lower integer value respectively, then <br/><br /> D(n, <math>\delta</math>) = <math>\langle</math> [dv'<sub>lo</sub>(n, <math>\delta</math>, t)<sup>2</sup> + dv'<sub>hi</sub>(n, <math>\delta</math>, t)<sup>2</sup>] / 2 <math>\rangle</math> <br/><br /> the angled brackets again indicating the mean across all t in the data segment yielding a velocity difference after the application of the Level 1 QC criteria | |||
### increment <math>\delta</math> and repeat steps until <math>\delta</math> = n<sub>max</sub> | |||
## increment n and repeat steps until n + (n<sub>max</sub> / 2) exceeds the bin number for which valid v’ are available | |||
# For a '''forward-difference''' scheme | |||
## start with n being the lowest number bin of the range over which the structure function is to be evaluated (number of bins in range must exceed n<sub>max</sub> | |||
### start with <math>\delta</math> = 1 | |||
### compute the second order structure function D(n,<math>\delta</math>) as the segment mean of the square of the velocity difference between the bin n and bin n + <math>\delta</math>: <br/><br /> D(n, <math>\delta</math>) = <math>\langle</math> [v’(n, t) - v’(n+<math>\delta</math>, t)]<sup>2</sup> <math>\rangle</math> <br/><br /> where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria | |||
### increment <math>\delta</math> and repeat steps until <math>\delta</math> = n<sub>max</sub> or n + <math>\delta</math> exceeds the last bin of the range over which the structure function is to be evaluated | |||
## increment n and repeat steps until n + 1 is the last bin of the range over which the structure function is to be evaluated | |||
# Including D(n, <math>\delta</math>) for <math>\delta</math> = 1 may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated | |||
# The number of instances when the squared velocity difference is evaluated for each bin n and separation distance <math>\delta</math>r<sub>0</sub> and their distribution are potential quality control metrics | |||
'''[IN PROGRESS]''' | |||
## Compute the second order structure function D(z,r) = mean-square of the velocity fluctuation difference: D(z,2*r0) = mean(v’(z+r<sub>0</sub>)-v’(z-r<sub>0</sub>))<sup>2</sup> | |||
## Repeat steps 5-6 for all pairs of bins where the separation distance between bins r <= r<sub>max</sub> | |||
# Check if all points involved in the differencing to contain good data, e.g. If I were starting from bin=2, with a maximum separation distance of 5, I required all data in bins 2 to 7 to meet QC requirements (usually just use correlation threshold). If yes, continue with the next step. If not, exclude this profile. | # Check if all points involved in the differencing to contain good data, e.g. If I were starting from bin=2, with a maximum separation distance of 5, I required all data in bins 2 to 7 to meet QC requirements (usually just use correlation threshold). If yes, continue with the next step. If not, exclude this profile. | ||
# With valid, contiguous data points, fit a line to the form D(z,r) = N + Ar<sup>2</sup>/3 to estimate values for A and N where A = Cv<sup>2</sup>ε<sup>2</sup>/3 and N is an estimate of the uncertainty due to noise. | # With valid, contiguous data points, fit a line to the form D(z,r) = N + Ar<sup>2</sup>/3 to estimate values for A and N where A = Cv<sup>2</sup>ε<sup>2</sup>/3 and N is an estimate of the uncertainty due to noise. |
Revision as of 17:58, 9 November 2021
- Extract or compute the along-beam bin center separation [r0] based on the instrument geometry
- Calculate the along-beam velocity fluctuation time-series in each bin, [v’(n, t)] from the Level 1 along-beam velocity data that has met the QC criteria
- If using burst sampling, calculations are done over the length of the burst or some sub-period over which the turbulent flow statistics can assumed to be stationary
- If using continuous sampling, calculations are dome over segments with a duration over which the turbulent flow statistics can assumed to be stationary
- For each data segment consisting of N profiles, the turbulent fluctuations are calculated separately for each beam and bin around either:
- The mean over the data segment
- A linear detrend of the segment
- A low pass filtered signal
- Select the maximum distance over which to compute the structure function based on conditions of the flow (e.g., expected max overturn) [rmax] in bin separation distances [nmax = rmax / r0]
- The structure function for a data segment can be calculated using either a bin-centred difference or a forward-difference scheme
- For a bin-centred difference scheme
- start at bin n = (nmax / 2) + 1
- start with [math]\displaystyle{ \delta }[/math] = 1
- if [math]\displaystyle{ \delta }[/math] is even compute the second order structure function D(n,[math]\displaystyle{ \delta }[/math]) as the segment mean of the square of the velocity difference between the bins separated by distance [math]\displaystyle{ \delta }[/math]r0 centered around bin n:
D(n, [math]\displaystyle{ \delta }[/math]) = [math]\displaystyle{ \langle }[/math] [v’(n+([math]\displaystyle{ \delta }[/math] / 2), t) - v’(n-([math]\displaystyle{ \delta }[/math] / 2), t)]2 [math]\displaystyle{ \rangle }[/math]
where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria - if [math]\displaystyle{ \delta }[/math] is odd compute the second order structure function D(n,[math]\displaystyle{ \delta }[/math]) as the segment mean of the mean of the square of the velocity difference between the bins separated by distance [math]\displaystyle{ \delta }[/math]r0 centered on the upper and lower extent of bin n:
dv'lo(n, [math]\displaystyle{ \delta }[/math], t) = v’(n+floor([math]\displaystyle{ \delta }[/math] / 2), t) - v’(n-ceil([math]\displaystyle{ \delta }[/math] / 2), t)
dv'hi(n, [math]\displaystyle{ \delta }[/math], t) = v’(n+ceil([math]\displaystyle{ \delta }[/math] / 2), t) - v’(n-floor([math]\displaystyle{ \delta }[/math] / 2), t)
where ceil and floor indicate the upper and lower integer value respectively, then
D(n, [math]\displaystyle{ \delta }[/math]) = [math]\displaystyle{ \langle }[/math] [dv'lo(n, [math]\displaystyle{ \delta }[/math], t)2 + dv'hi(n, [math]\displaystyle{ \delta }[/math], t)2] / 2 [math]\displaystyle{ \rangle }[/math]
the angled brackets again indicating the mean across all t in the data segment yielding a velocity difference after the application of the Level 1 QC criteria - increment [math]\displaystyle{ \delta }[/math] and repeat steps until [math]\displaystyle{ \delta }[/math] = nmax
- increment n and repeat steps until n + (nmax / 2) exceeds the bin number for which valid v’ are available
- start at bin n = (nmax / 2) + 1
- For a forward-difference scheme
- start with n being the lowest number bin of the range over which the structure function is to be evaluated (number of bins in range must exceed nmax
- start with [math]\displaystyle{ \delta }[/math] = 1
- compute the second order structure function D(n,[math]\displaystyle{ \delta }[/math]) as the segment mean of the square of the velocity difference between the bin n and bin n + [math]\displaystyle{ \delta }[/math]:
D(n, [math]\displaystyle{ \delta }[/math]) = [math]\displaystyle{ \langle }[/math] [v’(n, t) - v’(n+[math]\displaystyle{ \delta }[/math], t)]2 [math]\displaystyle{ \rangle }[/math]
where the angled brackets indicate the mean across all t for the data segment yielding a velocity difference after the application of the Level 1 QC criteria - increment [math]\displaystyle{ \delta }[/math] and repeat steps until [math]\displaystyle{ \delta }[/math] = nmax or n + [math]\displaystyle{ \delta }[/math] exceeds the last bin of the range over which the structure function is to be evaluated
- increment n and repeat steps until n + 1 is the last bin of the range over which the structure function is to be evaluated
- start with n being the lowest number bin of the range over which the structure function is to be evaluated (number of bins in range must exceed nmax
- Including D(n, [math]\displaystyle{ \delta }[/math]) for [math]\displaystyle{ \delta }[/math] = 1 may be inappropriate since the velocity estimates from adjacent bins are not wholly independent, therefore the impact of its inclusion should be evaluated
- The number of instances when the squared velocity difference is evaluated for each bin n and separation distance [math]\displaystyle{ \delta }[/math]r0 and their distribution are potential quality control metrics
[IN PROGRESS]
- Compute the second order structure function D(z,r) = mean-square of the velocity fluctuation difference: D(z,2*r0) = mean(v’(z+r0)-v’(z-r0))2
- Repeat steps 5-6 for all pairs of bins where the separation distance between bins r <= rmax
- Check if all points involved in the differencing to contain good data, e.g. If I were starting from bin=2, with a maximum separation distance of 5, I required all data in bins 2 to 7 to meet QC requirements (usually just use correlation threshold). If yes, continue with the next step. If not, exclude this profile.
- With valid, contiguous data points, fit a line to the form D(z,r) = N + Ar2/3 to estimate values for A and N where A = Cv2ε2/3 and N is an estimate of the uncertainty due to noise.
- Solve for ε using Cv2 = 2.1
- Repeat the steps in (5) – (9) for each bin until zb + rmax/2 >= end of profile
Return to ADCP Flow Chart front page