Description of process

..

...

Reliability Transcription Process for Connected Speech Samples

To ensure the reliability of transcriptions for connected speech samples, the following structured process will be implemented:

1. Randomized Sample Selection:
   A subset equivalent to 20% of the total transcription samples will be randomly selected for reliability testing. This selection will be project-specific, with examples including DrSantos_Spa_WABs_FTLD_2024 or Kesha_nfvPPA_lvPPA_2024.

2. Initial Comparison for Reliability:
   The selected samples will be assessed for transcription accuracy using the CLAN software. Two key metrics will be evaluated:

   • Percentage of Utterances with Matching Codes: Calculated as the proportion of all utterances where the assigned codes match perfectly between transcribers.

   • Percentage of Words with Matching Codes: Calculated as the proportion of individual words with identical coding across transcriptions.

3. Discrepancy Resolution:
   If 100% agreement is not achieved:

   • A meeting will be scheduled between the involved transcribers to review discrepancies.

   • Consensus will be reached on the appropriate transcription for all disputed elements.

4. Finalization of Reliable Transcriptions:
   Following the consensus meeting:

   • Edits will be made to the coded transcriptions based on agreed-upon revisions.

   • The transcription will then be considered finalized for reliability.

5. Documentation of Process:
   All reliability calculations and consensus resolutions will be documented for project records, contributing to transparency and repeatability in the transcription process.

Overview of the reliability folder structure in Box:

See steps that are needed for the reliability procedures:

...