Johnson, S.M., Christensen, A., and Bellamy, G. T. Evaluation of family intervention through unobtrusive audio recordings: Experiences in “bugging children.” Journal of Applied Behavior Analysis 1976,9, 213-219. Farkas, G.M. Correction for bias in a method of calculating the Interobserver agreement. Journal of Applied Behavior Analysis 1978,11, 188. In the rest of this article, three general categories of reliability metrics are explained: (a) on the basis of events, (b) on the basis of intervals and (c) on the basis of duration. Event-based measurements can be considered any form of IOA based on data collected using event records or frequency counts during observations. Interval-based data is provided from data collected through interval recordings (for example. B, partial or partial recordings) or as part of a regular sampling procedure. Finally, time-based algorithms are used when data is derived from timing (for example. B latency, durations, inter-response time). Interested readers can view each of the three tables in this manuscript based on the relative strengths of each algorithm and view the mathematical form of each algorithm in Appendix A.
Nevertheless, the user should always consult the research literature in order to obtain accurate information about when, why and how algorithms are used, given the nuanced aspects of their data. Note that the calculator table, an example of a calculation table completed with a brief explanation of the IOA analyses, is available on the “Behavioural Analysis in the Http://www.abainternational.org/Journals/bap_supplements.asp” site of the practice. Interested readers are encouraged to discuss IOA algorithms further and information on how to opt for a good metric on pages 114 to 120 of Cooper et al. (2007). Harris, F.C. and Lahey, B.B. A method to combine event and non-attendance assessments. Journal of Applied Behavior Analysis 1978,11, 523-527. House, A.E., House, B.J. – Campbell, M.B. Measures of interobserver agreement: Calculation formulas and distribution effects.
Journal of Behavioral Assessment 3, 37-57 (1981). doi.org/10.1007/BF01321350 Cohen, J. A coefficient of agreement for nominal scales. Educational and psychological measure 1960,20, 37-46. Holley, J. A., and Guilford, J. P. Reference to the G index of the agreement. Educational and psychological measure 1964,24, 749-753.