Page Comparison

...

1. Randomized Sample Selection:
   A subset equivalent to 20% 10% of the total transcription samples will be randomly selected for reliability testing. This selection will be project-specific (for example DrSantos_Spa_WABs_FTLD_2024, Kesha_nfvPPA_lvPPA_2024)

2. Initial Comparison for Reliability:
   The selected samples will be assessed for transcription accuracy using the CLAN software and using Rely (How to use RELY on CLAN). Two key metrics will be evaluated:

   • Percentage of Utterances with Matching Codes: Calculated as the proportion of all utterances where the assigned codes match perfectly between transcribers.

   • Percentage of Words with Matching Codes: Calculated as the proportion of individual words with identical coding across transcriptions.

3. Discrepancy Resolution:
   If 100% agreement is not achieved:

   • A meeting will be scheduled between the involved transcribers to review discrepancies. It’s recommended to have this meeting after running through Rely all the samples used for reliability.

   • Consensus will be reached on the appropriate transcription for all disputed elements.

4. Finalization of Reliable Transcriptions:
   Following the consensus meeting:

   • Edits will be made to the coded transcriptions based on agreed-upon revisions in the same meeting.

   • The transcription will then be considered finalized for reliability and all the samples of that project will be considered reliable enough to extract the linguistic measurements.

5. Documentation of Process:
   All reliability calculations and consensus resolutions will be documented in the Connected Speech Reliability Smartsheet Reports for project records, contributing to transparency and repeatability in the transcription process.

...