Kappa Pair Finding Routine

<< Click to Display Table of Contents >>

Navigation:  Reliability Checks > KAPPA - Inter-Rater-Reliability > Kappa parameters >

Kappa Pair Finding Routine

IMPORTANT: INTERACT compares only Codes within matching DataSets.
This means codes from DataSet 1 of data file A will only be compared to codes from DataSet 1 of data file B.

This is the routine followed by INTERACT, if you start the Kappa routine. You can even follow this routine on a step by step journey:

Click the Step through algorithm button Btn_KappaStepThroughAlgorithm to walk through your data, following the steps as described below.

1. Step: Matching Codes that overlap in time

For each Code in DataSet 1_A, that is not yet labeled: If matching codes are found in DataSet 1_B, which do overlap each other in time, for at least the percentage defined in the Kappa Parameter dialog, label and link those codes as a match.

2. Step: Matching Codes in temporal proximity

For each Code in DataSet 1_A that is not yet labeled: If the start time of the matching code in DataSet B, lays within the time frame defined with the first offset value in the Kappa Parameter dialog AND this code has not yet been labeled and linked to another Code, than label and link those codes as a match.

3. Step: Different Codes in temporal proximity

For each code in DataSet 1_A that is not yet labeled: If the start time of a different Code in DataSet 1_B, lays within the time frame (defined with the first offset value in the Kappa Parameter dialog) and this Code has not been labeled and linked to another code yet, than link those two Codes. Those Codes will be labeled as a mismatch. If more than one Code fits this criterion, link only the first one found.

4. Step: Different Codes in temporal proximity, that have not yet been linked

For each code in DataSet 1_A that is not yet labeled:  If the start time of a different code in DataSet 1_B, lays within the time frame (defined with the offset value in the Kappa Parameter dialog), than link those two Codes. Those codes will be labeled as a mismatch. If more than one code fits this criterion, link only the first one found.

5. Step: Link left over Codes

For each code in DataSet 1_A that is not yet labeled: Link those Codes with any Code from DataSet 1_B, if there is an unlabeled Code that overlaps, for at least the percentage defined in the Kappa Parameter dialog

6. Step: Leave Codes that have not yet been linked as they are.

Those Codes will be counted as: "Observer A has seen X whereas Observer B has seen nothing" and are listed under "No Pairs".

KappaGraph