Note from Katie Novak: We originally posted this blog in June 2022 before I had the opportunity to read the book, A Repair Kit for Grading: 15 Fixes for Broken Grades, and chat with the author, Ken O'Connor. He shifted my thinking about assessments, grades, and grading, and we made updates to this blog, and our grading flowchart, based on this learning and unlearning. One of the ideas from the book that completely shifted my thinking was the distinction between marks and grades. O'Connor writes:
We highly recommend the book if you're struggling to transform your classroom, school, or district to one where grades better represent student mastery of grade-level learning.
There are a lot of transformational ideas circulating about grading lately. Our Novak Education colleague, Chris Bronke, provides a great definition of Standards Based Grading in his article on Standards Based Learning. Other educators like Irvin Peckham and Alfie Kohn “offer compelling evidence for higher quality student work and more meaningful opportunities for instruction when grades are either eliminated or nearly unrecognizable as grades.” (Morgan 2020) Tamony discusses how important it is for us to make sure that “grading methods accurately report content knowledge” (Tamony 2021). And others have discussed better ways to make grading more effective and efficient (Barber & Nester, 2018; O'Connor, 2019). In this blog, we want to discuss how we can make assessment practices, marking, and ultimately grading students more compatible with Universal Design for Learning (UDL).
UDL is all about providing options and choices for your students so that you can eliminate barriers and allow each student to succeed both in and outside of school. Yet, our assessment and grading practices are so often punitive and not focused on really measuring what matters. How can we change that? How can create a unique assessment system that gives students a voice, choice, and autonomy and help students learn?
This UDL Assessment Flowchart that we created can help guide you through your UDL assessment process. It starts off by creating informal diagnostic and formative assessments that allow students to grade themselves and gives multiple opportunities for students to practice the topic at hand, revise submitted work without penalty, reflect on what they are doing, get mastery-oriented feedback, and review their assessments.
Review the UDL Assessment Flowchart in outline form (Word Doc) (PDF).
UDL grading starts way before you give out an assignment or test or even before you begin the lesson. It starts with finding out where your students are with the content or topic at hand. This usually means that you do some sort of diagnostic and formative assessment. Starting with a diagnostic or formative assessment is particularly important during (and after) this COVID crisis. The California department of education states that “deep concerns about learning loss have triggered an urgency that district and school staff have in place useful diagnostic assessments that can identify where students are in their learning within key content areas when they return to school so teachers can teach them most effectively.” The Teaching and Learning in Higher Education website adds: “The goal is to get a snapshot of where students currently stand - intellectually, emotionally or ideologically - allowing the instructor to make sound instructional choices as to how to teach the new course content and what teaching approach to use.”
Now, let’s face it, you can’t wait until you have the results of these assessments to plan out the lesson and the rest of the assessments, but as an experienced teacher, you can use the results of diagnostics to customize the plan that you have already created. A UDL lesson already has options and choices embedded because you have already proactively planned for variability, but the diagnostic can give you very important insight into adjustments you will need to make or choices or assessments you might need to add or remove to make the learning experience more accessible and engaging. It will also provide the students with an important progress monitoring tool and help them self-differentiate based on what they already know or can do.
A summative assessment is just part of the full story. It is critical that learners have numerous opportunities to share what they know to support self-assessment and teacher instruction before completing summative assessments, which may be marked and may contribute to a student's grade in the course.
Your assessments need to be based upon the standards and objectives that you stated at the beginning of the lesson, and it also needs to provide options for the students to choose so that they can best show you what they have learned. These options and choices will also help reduce or eliminate “test anxiety.”
Dr. David Rose, one of the original creators of the UDL framework, states that “when we consider learner variation in affective, recognition, and strategic networks, we realize that in order for assessments to focus accurately on what is being assessed, they need to be adjustable to meet learner variability. To get the most accurate data about what students understand and can do, assessments should not offer only one means of response but should provide multiple opportunities in varied media for learners to demonstrate skills and express themselves.”
Additionally, “such flexibility in assessment also has a role in encouraging students to seek knowledge beyond the requirements of the assignment they are being asked to do, especially as they have chosen what interests them. Furthermore, the integration of UDL into assessment is not only beneficial to students, but also to faculty, as these practices would enable them to look more deeply at the course's goals and objectives, to determine what students should show during the learning process, and to notice the students' enthusiasm and creativity in their courses”(Alsalamah, 2020).
Identify potential barriers within “one-size-fits-all” design and redesign using UDL best practices so students have numerous options and choices to learn and share their learning.
It is often stated that “we learn from our mistakes,” but we can only learn from our mistakes when we are given opportunities to correct them! It’s suspect that anyone deeply learns from their mistakes when assessments provide nothing more than checks, “‘x’s,” and non-specific comments. Students need to go back into the assessment and correct what needs improvement. Some educators feel that this process is unfair to the students who get the answer right the first time, but when we believe in standards-based or mastery-based grading, we recognize that the outcomes of the learning are more important than how quickly students reach those outcomes. In standards-based grading, grades reflect current learning and not past mistakes.
Revisit your assessment procedures to encourage a growth mindset and ensure that student learning reflects their current learning, not previous attempts (i.e., averaging original marks and retakes).
Students need to know how a particular assessment will be assessed, and they need to have a tool to help them self-assess their work and monitor their progress toward reaching a goal. “Students can use the rubrics to self-assess. The students can answer the essential questions with their own big ideas. This empowers the students.” (OCALI, n.d.) The type of rubric you use is less important than the fit that the rubric has to the assessment. UDL does not have an ideal rubric type, that is to say, the ideal rubric for UDL is the one that can accurately support the measurement of student knowledge for the course learning outcome(s) without constricting the options of how a learner can show what they know. A rubric designed with UDL in mind takes into consideration:
Learn more about the different types of rubrics here.
Build a rubric that can be universally applied to all options regardless of the mode of delivery so that learners truly understand how mastery will be assessed.
You can’t assess a student's work if you haven’t evaluated the standards and goals first, and you can’t assign a mark on an assessment if you are not clear about what fulfills the standards or goals when the students show what they know. The University of Illinois (n.d.) Center for Teaching Innovation has a full website of “Assigning Course Grades” that offers some helpful suggestions as you transition to competency or standards-based grading..
Consider revising assessments and rubrics so that the outcomes truly measure whether or not the student has met the standard/outcome.
If we don’t embrace and fully understand our standards and objectives, our rubrics may not be meaningful, may assess criteria that are not construct relevant, and may result in marks that don't reflect student learning. Carefully constructed rubrics, when aligned with standards, will help students and teachers determine the quality of the work and its alignment to mastery.
In his book, "A Repair Kit for Grading: 15 Fixes for Broken Grades," O'Connor, our new assessment bestie, provides detailed guidance on how to create effective rubrics, including advice on what to include in a rubric, how to write clear and specific criteria, and how to involve students in the process of developing the rubric and using it for planning and self-assessment.
💡This would be a great topic for your next department meeting or faculty professional development day!
Make sure that you have accurately valued each component in the assessment to match the importance of the information. Some things should be worth more than others!
In UDL Theory and Practice, Meyer, Rose, and Gordon state, “Most importantly, explicit formative assessment can provide a basis for individual learners to become more self-aware-more metacognitive -- about their learning. By modeling continuous prompts for reflection, teachers can begin to support students in monitoring their own progress. Effective scaffolding and mentorship helps students learn to assess their individual effort and persistence over time and ultimately gain a sense of autonomy over their own learning. The data collected from formative assessment can also be valuable to other teachers and parents as they work with that same learner. Intentional, ongoing assessments benefit not only individuals but also whole school communities.”
Dr. John Hattie confirms this in Visible Learning MetaX (Corwin Visible Learning Plus, n.d.). His research shows that self-reported scores have a very positive impact on student outcomes. His meta-analysis of 250 studies on over 79K students shows an effect size of 1.33 and a high confidence rating (anything over .4 is a considerable effect and is in the top 10!). Allowing students to self-report is also a great opportunity for a “teaching moment” where you can review what the student self-reports and discuss the reality of their knowledge or skill; this becomes a great opportunity to provide mastery-oriented feedback.
Consider adding the opportunity for each student to reflect on their performance and assess themselves while also reflecting on how their choices throughout the unit impacted their learning. (You will always have the right and responsibility to disagree!)
It is critically important that marks and grades reflect a student’s learning. UDL Theory and Practice explains this perfectly, “Whether formative or summative, assessments need to be on-target to measure the construct-the affect, concept knowledge, or skill-they are intended to measure. It is common for factors that are irrelevant to the goal of an assessment to interfere with its accuracy. For example, requiring a response to be hand-written may conflate handwriting or spelling difficulty with lack of knowledge about a subject. Similarly, requiring students to take a test in a fixed amount of time may conflate stress-management skills with level of understanding.”
Removing the penalty does not mean you can’t identify an error; it just means that the student won’t be penalized for an error not aligned with the standard or goal, like a spelling error in a math test.
Every assessment is an opportunity to continue the learning process of the lesson. Mastery-oriented feedback is essential to support ongoing learning. An assessment may happen at the end of a lesson, but it is not the end of the learning on the topic. Feedback should “guide learners toward mastery rather than a fixed notion of performance or compliance; towards successful long-term habits and learning practices" (Nguyen, 2021). Furthermore, feedback under the UDL Guidelines must make sure to:
Consider adding time to give this mastery-oriented feedback so that students will not only know why they received a particular score but also know where to get more information or increase their knowledge.
This may be the simplest step in the process, but it is sometimes ignored due to time constraints or department policies. The students need to be able to discuss what they got right and missed, and they need a chance to rework and resubmit whenever possible. I know that time is precious and that there is never enough of it, but learning should be more than a race to cover as much material as possible so that we can help build independent, resourceful, and knowledgeable students who become expert learners.
Students need to be able to learn from the assessment too! Just a score is not enough.
We hope you find the UDL Assessment Flowchart helpful and continue to reference it (or share it!) We're big fans of printing out this flowchart and posting it on the wall near your desk to remind you of the importance of not only making your lessons universally designed but also ensuring that your assessment practices align with practices that optimize expert learning. Download the UDL Assessment Flowchart.
Implement more equitable assessment practices in your learning environment.
Sources