...
Randomized Sample Selection:
A subset equivalent to 20% of the total transcription samples will be randomly selected for reliability testing. This selection will be project-specific , with examples including (for example DrSantos_Spa_WABs_FTLD_2024 or , Kesha_nfvPPA_lvPPA_2024.)Initial Comparison for Reliability:
The selected samples will be assessed for transcription accuracy using the CLAN software. Two key metrics will be evaluated:Percentage of Utterances with Matching Codes: Calculated as the proportion of all utterances where the assigned codes match perfectly between transcribers.
Percentage of Words with Matching Codes: Calculated as the proportion of individual words with identical coding across transcriptions.
Discrepancy Resolution:
If 100% agreement is not achieved:A meeting will be scheduled between the involved transcribers to review discrepancies.
Consensus will be reached on the appropriate transcription for all disputed elements.
Finalization of Reliable Transcriptions:
Following the consensus meeting:Edits will be made to the coded transcriptions based on agreed-upon revisions.
The transcription will then be considered finalized for reliability.
Documentation of Process:
All reliability calculations and consensus resolutions will be documented in the Connected Speech Reliability Smartsheet Reports for project records, contributing to transparency and repeatability in the transcription process.
...