Testing in large-enrollment online courses presents logistical challenges. Thoughtful strategies can ensure fairness, integrity, and accessibility. This guide outlines testing solutions available at OHIO, along with difficulty ratings, pros and cons, and essential tips to help you optimize your assessment approach. The difficulty rating indicates the level of effort required of the instructor to implement, adjust, and monitor the option. The ratings also consider how much effort it takes for a student to use the option.
Option 1: Canvas Test Banks
Test banks can be created in Canvas and used as question repositories.
Difficulty Level: ★☆☆ (Easy)
Pros:
- Randomizes questions and answer choices to reduce academic integrity risks.
- Integrates seamlessly with Canvas, allowing automated grading.
- Scalable and customizable for various question types.
- Cost-effective, especially with Open Educational Resources (OERs).
Cons:
- Requires time to build comprehensive test banks, initially.
- Limited to Canvas-supported question types.
Key Tips:
- Regularly search for your test bank questions online to ensure the assessment hasn’t been compromised.
- Students who miss the final should always take a different version of the test at a later date to maintain fairness and integrity.
Recommendation:
Canvas test banks are the most effective solution for large-enrollment courses, providing scalability, cost-effectiveness, and ease of use. Incorporating Open Educational Resources (OERs) ensures accessible, affordable learning materials.
Option 2: TopHat Testing Features
Monitored Exams in Top Hat that can be accessed via Canvas. This ensures the integrity of the exam process while providing a seamless experience for students.
Difficulty Level: ★★☆ (Moderate)
Pros:
- Interactive, engaging format for quizzes and exams.
- Customizable question types with instant feedback.
- Integrates with Canvas for grading and analytics.
Cons:
- Requires students to have access to devices with specific software during exams.
- May not address academic integrity concerns as robustly as proctoring, since it only monitors what is on the device and not what may be with the student.
- Instructors need familiarity with TopHat features and how to use them in-person.
Key Tips:
- Combine TopHat with randomized question pools for greater security.
- Monitor TopHat assessments to ensure questions are not shared publicly.
Recommendation:
TopHat is ideal for in-class or hybrid formats where interactive learning and engagement are priorities.
Option 3: Proctortrack for Online Proctoring
Online Proctoring is a fee-based service that allows students to take a proctored exam on their own device from a location of their choosing if their instructor has enabled the feature for their course.
Difficulty Level: ★★☆ (Moderate)
Pros:
- AI-driven monitoring detects and flags potential integrity breaches.
- Works well with Canvas for secure online assessments.
- Effective for high-stakes, fully online exams.
Cons:
- Added cost for students.
- Requires students to meet technical requirements, such as stable internet and webcams.
- Can lead to student anxiety or technical challenges during exams.
- May require robust technical support.
Key Tips:
- Clearly communicate proctoring expectations and provide a practice test.
- Regularly review flagged cases to ensure fair evaluation.
Recommendation:
ProctorTrack is a strong option for courses with fully online exams that require strict proctoring (think: licensure!). Ensure technology access for all students and provide alternatives when necessary.
Option 4: In-Person Exams via OHIO Testing Center
OHIO Testing Services prioritizes exam supervision for Ohio University students who require proctoring for accommodated exams and for proctoring high-stakes exams for OHIO online courses.
Difficulty Level: ★★★ (Challenging)
Pros:
- High control over testing conditions.
- Avoids reliance on internet or software.
- Reduces digital integrity concerns.
- Facilitates students’ accommodations during examinations.
Cons:
- Requires significant logistical coordination for students and faculty.
- Can lead to student anxiety or technical challenges during exams. Online courses should consider consulting with OHIO Online before leveraging in person proctoring.
Key Tips:
- Plan exams before the term starts and communicate testing expectations in the course offerings.
- For students who miss the final, ensure they take it after the rest of the class and with an alternate version of the exam.
Recommendation:
Plan ahead to minimize logistical hurdles.
Case Study: Maintaining Assessment Integrity
A professor teaching a 600-student economics course used Canvas test banks with OER-based questions. To maintain security, the instructor conducted periodic web searches for leaked questions and updated the bank as needed. Students who missed the final were required to take an alternate version later, ensuring fairness and preventing potential collusion. By combining randomized question pools and proactive security checks, the course maintained academic integrity while scaling assessments efficiently.
For assistance in implementing these strategies, contact the instructional design team at oid@ohio.edu .