Today we’re excited to welcome Mary Ellen Dello Stritto and Kathryn Linder from the Oregon State University Ecampus Research Unit to introduce an excellent new resource: the Report Reader Checklist. This checklist is a set of criteria that can help guide report readers and evaluate online education.

Thank you to Mary Ellen and Katie for joining us to review this important resource. Congratulations on its release!

Enjoy the read and enjoy your day,

Lindsey Downs, WCET


The Oregon State University Ecampus Research Unit is excited to share a new resource we created to help a range of stakeholders make data-driven decisions. Our new Report Reader Checklist includes a comprehensive set of criteria that offers a guide for those who are reading reports to evaluate the quality and rigor of online education study reports that they may encounter in their work. The checklist features six focus areas:

  1. context,
  2. methodology,
  3. sample,
  4. reporting results,
  5. transparency, and
  6. reader experience.

Marketing image showcasing the Report Reader Checklist from Oregon State University Ecampus. Includes hyperlink ecampus.oregonstate.edu/checklist.

Purposes of the Report Reader Checklist

The Report Reader Checklist was created to serve three main purposes:

  1. The Report Reader Checklist serves as a guide for administrators and stakeholders in the field of online teaching and learning who need or want assistance with reading and understanding the results of various research reports.
  2. The Report Reader Checklist empowers readers in the field of online teaching and learning to confidently identify the strengths and weaknesses of study reports as they make decisions and/or take specific actions based on study results.
  3. The Report Reader Checklist can be used as a resource for increasing research literacy in the field of online teaching and learning.

The checklist is intended to provide an overview of the foundational elements that should be included when reporting  the results of a study. Report readers can then apply each checklist criterion to a report to determine whether that element has been included or not. If readers find one area (e.g., “Context” or “Methodology”) that is missing several criteria within a report, this  would indicate that a report is weaker in that particular area.

The Six Areas and the Criterion

The six areas of criterion from the checklist including context, methodology, sample, reporting results, transparency, and reader experience.

The following contains an overview of the six areas of the checklist, along with the criterion in each area:

Context

Does the report describe the larger purpose of the study? Does it explain the history or theoretical framework? Does the report include research goals and suggestions for further research?

Methodology

Does the report have a methodology section? Is it clear how data were collected and analyzed? If the study used statistics, were they named? If coding was used, was the procedure described?

Sample

Are the study participants described in detail? Is it clear how participants were recruited? Does the sample represent an appropriate level of diversity? Are subgroups appropriately identified?

Reporting Results

Are all numbers in the report easy to comprehend? Is the “N” provided? Does the report identify missing data? Is it clear where study findings fit with the study’s purpose? Do data visualizations enhance your understanding of the results?

Transparency

Are raw data included in the report? Are instruments or study protocols provided in the report? Are the authors clear about any conflicts of interest? Is the discussion rooted in data results?

Reader Experience

Does the report use language that is easy to understand? Is the report ADA accessible? Does it include a summary or abstract? Is the study an appropriate length?

Download a one-page PDF of the checklist and access additional details for each criterion and our list of exemplar reports for each criterion.

Mary Ellen Dello Stritto
Mary Ellen Dello Stritto
Assistant Director
Ecampus Research Unit, Oregon State University
maryellen.dellostritto@oregonstate.edu

 

Linder headshot
Kathryn Linder
Director
Ecampus Research Unit, Oregon State University
kathryn.linder@oregonstate.edu

 

 

About the Oregon State University Ecampus Research Unit: The OSU Ecampus Research Unit makes research actionable through the creation of evidence-based resources related to effective online teaching, learning, and program administration. The OSU Ecampus Research Unit is part of Oregon State Ecampus, the university’s top-ranked online education provider.

 


CC Logo

Learn about WCET Creative Commons 4.0 License

 

1 reply on “Announcing the Report Reader Checklist: Your newest research resource”

Comments are closed.

Subscribe

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 2,369 other subscribers

Archive By Month

Blog Tags

Distance Education (314)Student Success (293)Online Learning (228)Managing Digital Learning (218)WCET (212)State Authorization (212)U.S. Department of Education (202)Regulation (195)Technology (168)Digital Learning (149)Innovation (125)Teaching (121)Collaboration/Community (114)WCET Annual Meeting (105)Course Design (103)Professional Development (98)Access (97)Faculty (88)Cost of Instruction (88)SAN (86)Financial Aid (84)Legislation (83)Completion (74)Assessment (69)Instructional Design (68)Open Educational Resources (66)Accreditation (64)COVID-19 (64)SARA (64)Accessibility (62)Credentials (62)Professional Licensure (62)Quality (62)Competency-based Education (61)Data and Analytics (60)Research (58)Diversity/Equity/Inclusion (57)Reciprocity (55)WOW Award (51)Outcomes (47)Workforce/Employment (46)Regular and Substantive Interaction (43)Policy (42)Higher Education Act (41)Negotiated Rulemaking (39)Virtual/Augmented Reality (37)Title IV (36)Practice (35)Academic Integrity (34)Disaster Planning/Recovery (34)Leadership (34)WCET Awards (30)Every Learner Everywhere (29)IPEDS (28)Adaptive/Personalized Learning (28)Reauthorization (28)Military and Veterans (27)State Authorization Network (27)Survey (27)Credits (26)Disabilities (25)MOOC (23)WCET Summit (23)Evaluation (22)Retention (21)Enrollment (21)Artificial Intelligence (20)Complaint Process (20)Correspondence Course (18)Physical Presence (17)WICHE (17)Cybersecurity (16)Member-Only (16)Products and Services (16)Forprofit Universities (15)WCET Webcast (15)Blended/Hybrid Learning (14)System/Consortia (14)Digital Divide (14)NCOER (14)Textbooks (14)Mobile Learning (13)Consortia (13)Personalized Learning (12)Futures (11)Marketing (11)Privacy (11)STEM (11)Prior Learning Assessment (10)Courseware (10)Teacher Prep (10)Social Media (9)LMS (9)Rankings (9)Standards (8)Student Authentication (8)Partnership (8)Tuition and Fees (7)Readiness and Developmental Courses (7)What's Next (7)International Students (6)K-12 (6)Lab Courses (6)Nursing (6)Remote Learning (6)Testing (6)Graduation (6)Proctoring (5)Closer Conversation (5)ROI (5)DETA (5)Game-based/Gamification (5)Dual Enrollment (4)Outsourcing (4)Coding (4)Security (4)Higher Education Trends (4)Mental Health (4)Fall and Beyond Series (3)In a Time of Crisis (3)Net Neutrality (3)Universal Design for Learning (3)Cheating Syndicates Series (3)ChatGPT (3)Enrollment Shift (3)Nontraditional Learners (2)Student Identity Verification (2)Cross Skilling/Reskilling (2)Virtual Summit (2)Higher Education (2)Title IX (1)Business of Higher Education (1)OPMs (1)Department of Education (1)Third-Party Servicers (1)microcredentials (1)Minority Serving Institution (1)