Calculate the Chance-Corrected R for Language Assessment — calc_chance

This function computes the chance-corrected R value, a measure used in the VOX analysis to evaluate agreement while accounting for chance. The R value adjusts for potential randomness in scoring or response patterns, providing a more accurate assessment of inter-rater or inter-response agreement.

Usage

calc_chance_corrected(df_input_response)

Arguments

df_input_response: A `data.frame` containing referent names and their associated responses, typically recorded by the listener. For example data, run `data("df_input_response_example")` or `data("df_input_response_previous_example")`.

Value

A numeric vector containing the chance-corrected R value for the provided data. This value can help assess consistency in language evaluations by controlling for chance agreement.

References

For more information on chance-corrected measures in agreement assessments, see: https://peterstatistics.com/CrashCourse/5-ThreeVarPair/binary/MultipleBinaryPaired3c.html

Examples

library(dplyr)
#> 
#> Attaching package: ‘dplyr’
#> The following objects are masked from ‘package:stats’:
#> 
#>     filter, lag
#> The following objects are masked from ‘package:base’:
#> 
#>     intersect, setdiff, setequal, union
data("df_input_response_example")
calc_chance_corrected(df_input_response = df_input_response_example)
#> [1] 0.1875