Test Building

OWL Pre-launch Checklist for Auto-Scored Exams 🚀

STEP 1: Build Your Test

Every Test MUST have at least ONE Section

All Sections MUST have at least ONE Item

ONLY ONE of each Item or Section (tracking #) is permitted on your Test

All Properties are Set (timers, progression, etc.)

Item and/or Section Randomization is set

Use the Points Editor to determine Test Scoring LAST

STEP 2: Review ALL Content with "Quick Preview"

 

Set all Preview options to No

Are Test Directions complete and properly formatted?

All sections are present and in build order

 

◻ Section layout is correct (One per Page vs. All per Page)

 

◻ Section header is correct (complete, free of typos, etc.)

All items are present and in build order

 

◻ Content is correct (complete, free of typos, etc)

 

◻ Proper item layout (vertical vs. horizontal Layout)

 

Make edits as necessary and repeat.

 

STEP 3: Preview Advanced Settings

 

Preview As Examinee = Yes, Select Target Language(s) if applicable, Set UI Localization if applicable

Section Randomization is as Intended

Item Randomization is as Intended

Option Shuffling (Multiple Choice, Drop Downs) is as Intended

Audio/video prompts are playing properly

Audio can be replayed if allowed

Timers are set properly and at the correct level:

 

◻ Test Timer

 

◻ Section Timers

 

◻ Item Response Timers

Navigation behavior (Forward v. At will)

 

Make edits as necessary and repeat.

 

STEP 4: Verify Exam Scoring

 

Preview As Examinee = Yes, Instant Item Results = Yes, Instant Test Results = Yes

Are correct/incorrect answers recognized? (look on item tabs)

Is Item scoring correct? (monitor points in upper right corner of tester)

Is case sensitive rating on Short Answer functioning as expected?

Is overall Test scoring correct? (look at Finish Test Tab)

   

 

Make edits as necessary and repeat.
IMPORTANT: If you make any changes to the test, REVISIT the points editor

 

 

STEP 5: Create Assignment

Create Your Assignment with all desired settings

 

NOTE: Do not use “Class Assign” or add actual students to the assignment roster at this time

Create a sample student account and add it to the assignment roster manually

 

 

STEP 6: Take the Exam as the Sample Test Taker

Log into OWL as the sample student and launch the activity

Are Assignment and Activity Titles Correct?

Does Test function as desired?

Is End of Test Feedback correct?

 


If changes are required, unlock the test by carefully deleting any samples responses.
Go to Assessment Menu >> Admin >> Responses
Edit as necessary and repeat.

   

Step 7: Look at Finalized Scoring

Go to the Assessment List Page. Did auto-scoring function as expected?

Did test automatically finalize?

 If student will be viewing their results in OWL, can you publish the results?

 Login as the sample student, can you view the results under My Completed Assignments?

 


 If changes are required, unlock the test by carefully deleting any samples responses.
 Go to Assessment Menu >> Admin >> Responses
 Edit as necessary and repeat.

 

 

Step 8: Run Reporting

 Are you getting desired information from the reporting?

 


 If changes are required, unlock the test by carefully deleting any samples responses.
 Go to Assessment Menu >> Admin >> Responses
 Edit as necessary and repeat.

 

Step 9: Assign the Test to Your Test Takers

 Did you delete all your sample responses so they don't show up in your reporting?

 Did you add users to the Assignment Rosters? OR
 ◻ Proctors
 ◻ Test Admins
 ◻ Students

 Did you edit the assignment to add the Class Assignment? OR

 

 

 You are Go for Launch! 🚀

 

 

PRINT CHECKLIST


;