Shear probes quality control metrics - Revision history

Marcus at 18:21, 6 June 2024

2024-06-06T18:21:23Z

← Older revision		Revision as of 18:21, 6 June 2024
Line 1:		Line 1:
	~~Spikes~~ in ~~epsilon estimates arise from a number of causes such as collisions of sensor tips~~ with ~~suspended particles~~ (e.~~g. detritus, plankton, jelly fish, seaweed~~), electronic noise ~~due to~~ other ~~sensors, or mechanical~~ platform ~~vibrations~~. This section describes quality control ~~measures~~ and ~~its~~ coding.		Shear-probe data can be corrupted or compromised in several different ways. These include but are not limited to (''i'') collision with plankton and other materials, (''ii'') unremovable vibrational contamination. (''iii'') electronic noise, and (''iv'') interference from other instrumentation on a platform that carries the shear probes. This section describes the quality control metrics and the coding used to [[Quality control coding\|identify]] them. Quality-control metrics that are currently identified include;

	~~In a ''first step'', epsilon estimates are flagged based on quality control metric and disagreement~~ between dissipation estimates from redundant sensors.		:* [[figure of merit (FOM)]]
			:* [[fraction of shear-probe data altered by the de-spiking routine]]
			:* number of [[iterations]] of the de-spiking routine required to clean the data
			:* [[agreement between dissipation estimates]] from redundant sensors (i.e. two or more shear probes)

	~~# Quality-control~~ metrics ~~that accompanied dissipation estimates are used to flag individual estimates. In particular~~, ~~quality control thresholds for~~		The numerical threshold for these metrics should depend, as much as possible, on the known statistical properties of a turbulence shear measurement. The numerical values of the QC codes (or flags) is found in [[Quality control coding\|QC-flags]].
	~~#:* [[figure of merit (FM)]]~~
	~~#:* fraction~~ of shear~~-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]~~
	~~#:* number of iterations~~ of the [[~~De-spike_the_shear-probe_data~~\|de-~~spiking routine~~]] ~~required to clean the data~~
	~~#:* (more to be discussed)~~
	~~# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist~~.

	~~Flagged~~ data ~~will receive~~ [[~~quality control coding~~]] 4.		Please note that most choices made must be included in a data set, as described in the [[Netcdf meta data (shear probes)\|list of meta data]].

	In a ''second step'' of quality control, a review of ensembles that have been flagged is performed. Individual shear spectra, associated tilt and acceleration data and microstructure thermistor data/spectra are visually examined for consistency. Previously flagged data that appears to be good data will receive [[quality control coding]] 2.

	~~Details for QC coding can be found [[Quality_control_coding\|here]].~~

CynthiaBluteau at 15:17, 23 November 2021

2021-11-23T15:17:56Z

← Older revision		Revision as of 15:17, 23 November 2021
Line 21:		Line 21:
	-----------------------------		-----------------------------
	return to [[Flow chart for shear probes]]		return to [[Flow chart for shear probes]]

			[[Category:Shear probes]]

Marcus at 11:57, 15 November 2021

2021-11-15T11:57:03Z

← Older revision		Revision as of 11:57, 15 November 2021
Line 3:		Line 3:
	In a ''first step'', epsilon estimates are flagged based on quality control metric and disagreement between dissipation estimates from redundant sensors.		In a ''first step'', epsilon estimates are flagged based on quality control metric and disagreement between dissipation estimates from redundant sensors.

	# Quality-control metrics ~~(see also Processing Steps section V)~~ that accompanied dissipation estimates are used to flag individual estimates. In particular, quality control thresholds for		# Quality-control metrics that accompanied dissipation estimates are used to flag individual estimates. In particular, quality control thresholds for
	#:* [[figure of merit (FM)]]		#:* [[figure of merit (FM)]]
	#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]		#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]

Marcus at 11:54, 15 November 2021

2021-11-15T11:54:40Z

← Older revision		Revision as of 11:54, 15 November 2021
Line 12:		Line 12:
	Flagged data will receive [[quality control coding]] 4.		Flagged data will receive [[quality control coding]] 4.

	In a ''second step'' of quality control, a review of ensembles that have been flagged is performed. Individual shear spectra, associated tilt and acceleration data and microstructure thermistor data/spectra are visually examined for consistency. Previously flagged data that appears to be good data will receive quality control coding 2.		In a ''second step'' of quality control, a review of ensembles that have been flagged is performed. Individual shear spectra, associated tilt and acceleration data and microstructure thermistor data/spectra are visually examined for consistency. Previously flagged data that appears to be good data will receive [[quality control coding]] 2.

	Details for QC coding can be found [[Quality_control_coding\|here]].		Details for QC coding can be found [[Quality_control_coding\|here]].

Marcus at 11:53, 15 November 2021

2021-11-15T11:53:21Z

← Older revision		Revision as of 11:53, 15 November 2021
Line 10:		Line 10:
	# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist.		# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist.

	Flagged data will receive quality control coding 4.		Flagged data will receive [[quality control coding]] 4.

	In a ''second step'' of quality control, a review of ensembles that have been flagged is performed. Individual shear spectra, associated tilt and acceleration data and microstructure thermistor data/spectra are visually examined for consistency. Previously flagged data that appears to be good data will receive quality control coding 2.		In a ''second step'' of quality control, a review of ensembles that have been flagged is performed. Individual shear spectra, associated tilt and acceleration data and microstructure thermistor data/spectra are visually examined for consistency. Previously flagged data that appears to be good data will receive quality control coding 2.

Marcus at 11:52, 15 November 2021

2021-11-15T11:52:16Z

← Older revision		Revision as of 11:52, 15 November 2021
Line 6:		Line 6:
	#:* [[figure of merit (FM)]]		#:* [[figure of merit (FM)]]
	#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]		#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]
	#:* number of iterations of the d[[De-spike_the_shear-probe_data\|e-spiking routine]] required to clean the data		#:* number of iterations of the [[De-spike_the_shear-probe_data\|de-spiking routine]] required to clean the data
	#:* (more to be discussed)		#:* (more to be discussed)
	# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist.		# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist.

Marcus at 11:51, 15 November 2021

2021-11-15T11:51:35Z

← Older revision		Revision as of 11:51, 15 November 2021
Line 6:		Line 6:
	#:* [[figure of merit (FM)]]		#:* [[figure of merit (FM)]]
	#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]		#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]
	#:* number of iterations of the de-spiking routine required to clean the data		#:* number of iterations of the d[[De-spike_the_shear-probe_data\|e-spiking routine]] required to clean the data
	#:* (more to be discussed)		#:* (more to be discussed)
	# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist.		# Agreement between dissipation estimates from redundant sensors (i.e. two or more shear probes) does not exist.

Marcus at 11:49, 15 November 2021

2021-11-15T11:49:14Z

← Older revision		Revision as of 11:49, 15 November 2021
Line 5:		Line 5:
	# Quality-control metrics (see also Processing Steps section V) that accompanied dissipation estimates are used to flag individual estimates. In particular, quality control thresholds for		# Quality-control metrics (see also Processing Steps section V) that accompanied dissipation estimates are used to flag individual estimates. In particular, quality control thresholds for
	#:* [[figure of merit (FM)]]		#:* [[figure of merit (FM)]]
	#:* fraction of shear-probe data altered by the de-spiking routine		#:* fraction of shear-probe data altered by the [[De-spike_the_shear-probe_data\|de-spiking routine]]
	#:* number of iterations of the de-spiking routine required to clean the data		#:* number of iterations of the de-spiking routine required to clean the data
	#:* (more to be discussed)		#:* (more to be discussed)

Marcus at 11:46, 15 November 2021

2021-11-15T11:46:14Z

← Older revision		Revision as of 11:46, 15 November 2021
Line 4:		Line 4:

	# Quality-control metrics (see also Processing Steps section V) that accompanied dissipation estimates are used to flag individual estimates. In particular, quality control thresholds for		# Quality-control metrics (see also Processing Steps section V) that accompanied dissipation estimates are used to flag individual estimates. In particular, quality control thresholds for
	#:* figure of merit (FM)		#:* [[figure of merit (FM)]]
	#:* fraction of shear-probe data altered by the de-spiking routine		#:* fraction of shear-probe data altered by the de-spiking routine
	#:* number of iterations of the de-spiking routine required to clean the data		#:* number of iterations of the de-spiking routine required to clean the data

Aleboyer at 03:28, 5 November 2021

2021-11-05T03:28:21Z

← Older revision		Revision as of 03:28, 5 November 2021
Line 15:		Line 15:

	Details for QC coding can be found [[Quality_control_coding\|here]].		Details for QC coding can be found [[Quality_control_coding\|here]].




			-----------------------------
			return to [[Flow chart for shear probes]]