tag:blogger.com,1999:blog-5335730546166957670.post1249156797547282168..comments2024-03-09T04:11:27.058-08:00Comments on K. Gwet's Inter-Rater Reliability Blog : A t-test for correlated agreement coefficients and application with the R package Kilem L. Gwet, Ph.D.http://www.blogger.com/profile/07245848619269593324noreply@blogger.comBlogger3125tag:blogger.com,1999:blog-5335730546166957670.post-8627034362146695312021-12-01T20:33:36.686-08:002021-12-01T20:33:36.686-08:00Thanks a lot. This was very helpful.Thanks a lot. This was very helpful.Anonymoushttps://www.blogger.com/profile/13884455263790780374noreply@blogger.comtag:blogger.com,1999:blog-5335730546166957670.post-78570033631374569492021-11-23T01:50:58.638-08:002021-11-23T01:50:58.638-08:00Hi,
No, you don't do the pairwise analysis. Y...Hi,<br />No, you don't do the pairwise analysis. You should perform a global comparison. Check the agreetest app using the following link: https://agreestat.net/agreetest/. The use of test datasets will show you how this analysis should be done.Kilem L. Gwet, Ph.D.https://www.blogger.com/profile/07245848619269593324noreply@blogger.comtag:blogger.com,1999:blog-5335730546166957670.post-62541631597345049202021-11-20T18:37:39.549-08:002021-11-20T18:37:39.549-08:00Hi,
I am comparing the inter-rater agreement among...Hi,<br />I am comparing the inter-rater agreement among 5 raters before and after an intervention on the same 40 subjects. Do I compare rater 1 ratings before the intervention to rater 1 ratings after the intervention and so on for each rater? How do I finally combine the 5 comparisons (1 for each rater) to decide if the intervention improves inter-rater agreement? How do I generate a final p value for the 5 comparisons. <br />Thanks<br />HythemAnonymoushttps://www.blogger.com/profile/13884455263790780374noreply@blogger.com