Please use this identifier to cite or link to this item: http://hdl.handle.net/10316/33167
Title: Training and Interobserver Reliability in Qualitative Scoring of Skeletal Samples
Authors: Wilczak, C 
Mariotti, V 
Pany-Kucera, D 
Villotte, S 
Henderson, Charlotte 
Keywords: Anthropology; Archaeology
Issue Date: Nov-2016
Publisher: Journal of Archaeological Science: Reports
Project: Wenner-Gren Foundation (grant number Gr. CONF-632) 
Fundação para a Ciência e a Tecnologia SFRH/BPD82559/2011 
Fundação para a Ciência e a Tecnologia FCT/Pest-OE/SADG/UI0283/20113 
Volume: 11
Place of publication or event: Journal of Archaeological Science: Reports
Abstract: This article reports on inter- and intra-observer reliability testing of the Coimbra method for fibrocartilaginous entheseal changes and discusses the results in the context of reliability for other qualitative methods that score skeletal variation. Four tests of interobserver and one test of intraobserver reliability were conducted. Three of the interobserver tests were conducted in person (Geneva, Coimbra A, Coimbra B) and one was conducted on-line. Before each test, the observers trained together and refinements were made to the method. Inter- and intra-observer reliability was assessed using percentage agreement, kappa scores, and Krippendorff’s alpha. On-line testing had the lowest reliability (60% agreement, κ = 0.292, α = 0.369). Final reliability results in the Coimbra B test increased from the initial Geneva test (68.6 to 80.0% agreement, κ = 0.522 to 0.589, α = 0.604 to 0.666). Factors such as training, observation conditions, visual acuity, and differences in interpretation of scoring criteria impact reliability. Suggestions are made to address the general problem of reliability in qualitative methods.
URI: http://hdl.handle.net/10316/33167
DOI: 10.1016/j.jasrep.2016.11.033
Rights: closedAccess
Appears in Collections:I&D CIAS - Artigos em Revistas Internacionais

Files in This Item:
File Description SizeFormat Login
Wilczak et al 2017 error paper.pdf996.44 kBAdobe PDF    Request a copy
Show full item record

SCOPUSTM   
Citations

12
checked on May 29, 2020

WEB OF SCIENCETM
Citations 5

12
checked on Oct 22, 2020

Page view(s)

114
checked on Oct 22, 2020

Download(s) 10

1,292
checked on Oct 22, 2020

Google ScholarTM

Check

Altmetric

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.