Total time: A shorter duration divided by the longer duration and multiplied by 100 This technical report provides detailed information on the reasons for using a common computer computing program (Microsoft Excel®) to calculate different forms of interobserver agreement for continuous and discontinuous data sets. In addition, we offer a brief tutorial for using an Excel table to automatically calculate the traditional total number, partial match in intervals, exact tuning, trial test, interval interval, multiple interval, total duration and average duration of interobserver duration algorithms. We conclude with a discussion of how practitioners can integrate this tool into their clinical work. Rated interval: Add up intervals that are marked by «yes» or intervals filled. Divide this number by the total number of intervals in the total number of IAOs. The IOA algorithm for the total number is the easiest way to evaluate IOA with event-based measurements. The total number of IOA refers only to the percentage of correspondence between the frequency/event records of two observers for the entire observation and is calculated by dering the smaller total number (from one observer relative to the other) by the largest total number (by the other observer). The IOA points interval. An approach to improve the accuracy of the agreement between two observers for interval recording is simply to limit agreement analyses to cases where at least one observer has recorded a target response in the meantime.
Intervals in which no observer has reported a target response are excluded from the calculation in order to provide stricter agree statistics. Cooper et al. (2007) suggest that the IOA point interval (also known as «deposit agreement» in the research literature) is most advantageous when targeted responses are at low rates. In the figure 2 examples, the second, third and fourth intervals are ignored for calculation purposes, as none of the observed intervals have been answered at these intervals. As a result, IOA statistics are only calculated from the first, fifth, sixth and seventh intervals. Since only more than half of the intervals (5th and 6th intervals) have been stopped, the approval rate is 50% (2/4). Trial-By: Comparing the agreement between the various discrete studies, instead of comparing the total number since Spearman and Brown first reported in 1910 how to quantify reliability between data sources, researchers refined ways of quantitatively communicating the link between independent measures (see Brennan, 2001). Today`s researchers are fortunate to have many statistical software packages (z.B. SPSS, STATA) that can instantly calculate a variety of reliability indicators, such as the Cronbach alpha or Pearson product torque coefficient.
While such statistics may be beneficial for classical test score theory or traditional views on the reliability of psychological scales, these statistics are not well suited to the analysis of data from individual experimental models. In addition, the above statistical software does not contain the standard behavioral analysis algorithms needed to calculate the reliability of individual data, such as interval or event-by-event average statistics. Therefore, the use of Excel is beneficial for behavioral analysts, as this program is widely used and easily designed for custom formulas and custom analytics. The most relevant idea for the current debate is that well-designed tables can reduce the data processing burden and improve the accuracy of analyses of users who are unfamila in statistics or computer programming.