The SLO Committee is offering a new service for those departments that use rubrics to assess their SLOs. The committee is offering this service because it recognizes that to collect and prepare student work for assessment consumes a lot of time, time that could be better spent preparing for class or assisting students.
For this reason, the SLO Committee, through the Division of Institutional Effectiveness and Student Success, will assist departments in collecting the student work and preparing it for assessment. In this way, we hope to give faculty the opportunity to focus their time and energy on assessing, analyzing and continuing to improve student learning through the SLO process.
Below is an explanation of how the service works.
Step One: Request for Assistance
Your department requests assistance by emailing Ronda Gartrell at firstname.lastname@example.org, providing her with the course name and number, and the number of course sections to be assessed.
Step Two: Collect Roster Sheets
Once the SLO Office receives your request for assistance, it collects copies of roster sheets and, based on the total number of enrolled students across all sections, determines the total number of student work to be assessed by the department. The number of papers to be assessed is determined by very simple guidelines suggested by Mary Allen, a noted expert in the field of SLO assessment:
- a course with a total enrollment of 100 to 200 students will assess between 50 and 60 samples of student work; (for a 10% margin of error)
- a course with a total enrollment of 201 to 400 will assess between 65 and 80 samples of student work; (for a 10% margin of error)
- a course with a total enrollment of more than 400 student will assess between 80 and 100 samples of student work. (for a 10% margin of error)
Step Three: Collect Random Samples of Student Work
With these guidelines, the SLO office randomly selects a sample of students from each section. The randomly selected students are highlighted on the rosters, and the rosters are sent back to the faculty, who in turn make copies of the student work for the selected students. The faculty then returns the marked roster sheets with copies of the selected student work to the department head. Once all the papers have been collected, they papers are delivered to the SLO Office.
Step Four: Prepare Student Work for Assessment
To prepare the student work for assessment, the SLO Office redacts the names of the student and instructor, assigns a number to each sample of student work, puts the papers in stacks of ten, and attaches to each stack two scoring sheets (each stack should be scored twice), and scoring rubric. These prepared stacks are returned to the department so that that they can be assessed by the department faculty.
Step Five: Assess Student Work
Each stack of student work is read by two independent readers. Once the department faculty has read each stack of student work twice, the SLO Office collects the assessment sheets and student papers, and tallies the assessment sheets, totaling the number of students scoring "Good," "Satisfactory," and "Emergent." If a paper is scored "Good" by one reader and "Satisfactory" by another, the paper is not scored a third time; the readers agree that the student has successfully demonstrated the SLO; however, they disagree as to how well the student demonstrated it. For this reason, these particular papers are totaled, and half is assigned to "Good" and half is assigned to "Satisfactory."
If, however, a paper is scored "Good" or "Satisfactory" by one reader and "Emergent" by another, then the paper has to be scored by a third reader. In such cases, the SLO Office informs the department head how many papers need a third reader. The department decides who all will score the papers; the faculty selected (conscripted) inform the SLO office when they plan to score the student work so that it can be properly prepared before the faculty arrive.
Step Six: Report Results
When the scoring is complete, the SLO Office totals the number of students scoring "Good," "Satisfactory," and "Emergent" and completes the SLO Results form. The completed form is sent to the department head, who shares it with the department and who together determine what improvements, if any, need to be made to the course.
While the department analyzes the results and responds accordingly, the SLO Office inputs the results into the database.