Thursday, March 5
11:15 AM-12:15 PM
UTC
Wando

Validity and Reliability of a Rubric for Assessing and Stimulating Quality in Effective Online Threaded Discussions

Brief Paper ID: 24678
  1. Jessica Hale
    Eastern Michigan University
  2. aaa
    David Anderson
    Eastern Michigan University

Abstract: This study tests the validity and reliability of a rubric created to assess quality in online threaded discussions. The participants in this study consist of faculty members: experts with extensive experience with online threaded discussions and operant users with varying experience levels. Using the Delphi method, experts evaluate and develop the construct validity of the rubric. Operant users, randomly assigned to the experimental or control group, apply the rubric to samples of online threaded discussions. Members of the experimental group receive a rubric training sequence prior to using the tool. Correlational, multiple regression, and generalized linear modeling analysis is used to analyze test-retest reliability, inter-rater reliability, and the impact of external rater factors on reliability. The outcome of this study is a tool that can be used by instructors to evaluate the quality of student contributions to threaded discussions consistently and objectively.

Presider: Amy Sedivy, University of Arkansas at Little Rock

Conference attendees are able to comment on papers, view the full text and slides, and attend live presentations. If you are an attendee, please login to get full access.
x