...
“The fourth function of the RELY command is to estimate the overall match between two transcripts on the main line. It is very difficult to define this type of comparison precisely. Instead, RELY uses a rough-and-ready "bag of words" comparison method that simply looks at the overall match of the main line items in the two versions. The command for this type of analysis adds the +d switch, and the output is the percentage of overall overlap.” (This is directly sourced from the CLAN manual: https://talkbank.org/manuals/CLAN.pdf)
This function provides two output calculations:
...
Type in the following code into the command window: rely +d sample.cha samplea.cha
Select “file in” and add the two coded files you wish to process. It may be helpful to and select “add all ->”Select “Run”
Once you’ve done so, select “done”.
Step: 3
After running, RELY provides a report showing percent agreement across your chosen categories. This breakdown helps identify areas where raters agree most and where further clarification might be needed.
Here is an example of what the reliability report looks like:
...