Specifications grading has become one of the most influential approaches in the alternative grading movement, but how has the model evolved since Linda Nilson first introduced it more than a decade ago? In this episode, Sharona and Boz sit down with Joe Packowski to discuss the newly released second edition of Specifications Grading and the journey that led him from a 25-year career in industry to becoming a leading voice in grading reform. The conversation explores the intersections between higher education and the workplace, the role of data and student feedback in refining grading systems, and how a growing community of practitioners is adapting specifications grading across disciplines and contexts. Along the way, the group reflects on mentorship, professional networks, and what it means for an educational innovation to move from a small pilot project to a global community of practice.
Links
Please note – any books linked here are likely Amazon Associates links. Clicking on them and purchasing through them helps support the show. Thanks for your support!
- Specifications Grading 2.0, by Linda Nilson and Joe Packowski
- The Personal Efficiency Program, by Kerry Gleeson
- The Four Disciplines of Execution, by Chris McChesney
- Specifications Grading on LinkedIn
- Joe Packowski on LinkedIn
Resources
The Center for Grading Reform – seeking to advance education in the United States by supporting effective grading reform at all levels through conferences, educational workshops, professional development, research and scholarship, influencing public policy, and community building.
The Grading Conference – an annual, online conference exploring Alternative Grading in Higher Education & K-12.
Some great resources to educate yourself about Alternative Grading:
Recommended Books on Alternative Grading:
- Grading for Growth, by Robert Talbert and David Clark
- Specifications Grading, by Linda Nilsen
- Undoing the Grade, by Jesse Stommel
Follow us on Bluesky, Facebook and Instagram – @thegradingpod. To leave us a comment, please go to our website: http://www.thegradingpod.com and leave a comment on this episode’s page.
If you would like to be considered to be a guest on this show, please reach out using the Contact Us form on our website, www.thegradingpod.com.
All content of this podcast and website are solely the opinions of the hosts and guests and do not necessarily represent the views of California State University Los Angeles or the Los Angeles Unified School District.
Music
Country Rock performed by Lite Saturation, licensed under a Attribution-NonCommercial-NoDerivatives 4.0 International License.
Transcript
===
ancements I’ve made since the:Boz: Welcome to The Grading Podcast, where we’ll take a critical lens to the methods of assessing students’ learning, from traditional grading to alternative methods of grading. We’ll look at how grades impact our classrooms and our students’ success. I’m Robert Bosley, a high school math teacher, instructional coach, intervention specialist, and instructional designer in the Los Angeles Unified School District and with Cal State LA.
Sharona: And I’m Sharona Krinsky, a math instructor at Cal State Los Angeles, faculty coach, and instructional designer. Whether you work in higher ed or K-12, whatever your discipline is, whether you are a teacher, a coach, or an administrator, this podcast is for you. Each week, you will get the practical, detailed information you need to be able to actually implement effective grading practices in your class and at your institution.
Boz: Hello, and welcome to The Grading Podcast i’m Robert Bosley, one of your two co-hosts, and with me as always, Sharona Krinsky. How you doing today, Sharona?
Sharona: I am quite tired. I am very tired. We had one of our summer camp shows last night. We did The Lion King Jr. at my theater company, and we had 50 kids and over 830 tickets that were booked for the show, about 700 and something that actually came to see the show. And so it’s everything from running concessions and merch and managing the show and asking for money, and then after we’re done, having to get out of the theater and drive back to the rehearsal space. And then this morning I had to get up and drive a 26-foot Penske box truck back to return it. So I am very tired. How are you doing, Boz?
Boz: Not bad. Those who’ve been listening to the podcast for a while knows that we actually share in that. You’ve drug me into that world as well, so yeah. I did not have to get up early to go take the Penske truck back, but yeah, I was the one loading and driving it last night from theater to your space. So I feel your pain ’cause that truck is a really big truck.
Sharona: Yes, but I make you drive it when it’s loaded. I’m only willing to drive it when it’s empty.
Boz: Also, my mom and brother have been out here for a few weeks. They’re still here, so still enjoying that.
Sharona: Yeah, I heard you guys went to the beach.
Boz: Yeah. We did, and most of us got a little sunburn, so that’s always fun. Yeah. But we’re not in the studio alone today, so who do we have with us, Sharona?
Sharona: I was gonna say, hopefully someone who is much more rested than either you or I. I am really excited to welcome Joe Packowski to the pod today. I met Joe a few weeks ago. He reached out and he’s a teaching faculty member within the communication, professional, and computer skills area at the Kelley School of Business at Indiana University. But he had over 25 years in industry as a sales professional and a recruiter for Fortune 500 companies, and what’s really exciting for us, he’s also one of the co-authors of the second edition of Specifications Grading with Linda Nilson. So someone who has been so influential with this community, and Joe actually got to work directly with her to write a book. You are probably one of the most envied persons in our community at this point. And he is working on an EdD, I believe, currently, and transitioning into education. He has so many different things. He has master’s of professional studies in organization development and change from Penn State. He studied political science at the University of Rochester and did a whole bunch of stuff in industry. I could go on and on, but I’d rather get to know you personally, so welcome, Joe, to the pod.
Joe Packowski: Oh, thank you both very much. And just a side note, you talk about vehicles and whatnot, I just returned from a 2,800-mile trip all across New England, Pennsylvania, and through Canada. I’m a little more rested now, but if we did this three days ago, maybe not so much.
Sharona: Okay. But was that… How big of a vehicle were you in for that trip?
Were you doing the RV thing or-
Joe Packowski: So we had a larger SUV. There were four of us initially. My oldest daughter works at Indiana University, so she had to fly back from New Hampshire. So there were four of us, but we planned accordingly. So we planned that every stop we’d make, we’d just do our laundry, pick up some various things, knowing whatever we bought would be in the position where my daughter sat. So, we planned accordingly. But it was the first time I was telling Boz that I actually celebrated my birthday in a different country. We celebrated that in Canada as a family, which is a super cool thing to say.
Sharona: That- That is cool … that’s amazing. Which might mean you were in Canada when we were in Canada, ’cause we were just in Toronto for a week, so that’s really fun.
Joe Packowski: But thank you for having me.
Boz: And welcome, and thank you for taking time out of your day to join us. There’s a ton of things that we wanna talk to you about, but something we always do with our new guest we wanna know just how did you get involved in this crazy world of alternative grading?
Joe Packowski: This is probably the most important question for me. So, I loved the corporate experience, right? Being with two Fortune 400 companies for 25 years, had incredible experience, a lot of successes, many more failures. But I was also a recruiter during that time and I just felt after that long period of time that, I wanted to give back. Frankly, I wanted a little bit more work/life harmony, but I also wanted to give back to the next generation of professionals. I had a chance to interview with a couple of different schools, and the Kelley School of Business afforded me the opportunity to become a lecturer teaching faculty member at the Kelley School of Business. And when I started, I never taught before, right? So yeah, I did some stuff in the classroom with some students, but it was a huge industry shift, but it was a mindset shift, right? I went from coaching and counseling direct reports to now having clients which are students, right? Multiple in the courses I’ll talk a lot more about. I have up to 300 students in sections. So when I taught my first class I wasn’t sure how it would go. Pedagogically, I was like, all right, let me just shadow somebody. Let me just see what you do, learn from you, and then adapt it to get to my, my way of teaching and engaging with students.
However, to your question, when I sat down at the end of that first semester and I looked at the grade distribution I literally paused and said, “Did X amount that earned an A truly learn?” Did the learning equate to the grade that they earned? And I thought about that and I said, you know what my industry experience showed that in the workforce, the vast majority of companies are going to have a performance appraisal where the end goal is gonna be you’re gonna be below, meets, or exceeds expectation. There is no 89.3 or 72.6. So with that inspiration of my industry knowledge, which is my number one priority I’ll mention this often in the podcast that my number one priority is to best report support students as they transition to the workforce. Letter grades and numbers are not going to support that transition, right? It’s helpful academically and if they continue to go on to masters and terminal degrees, but it really doesn’t help them transition to the workforce. So when I looked at that and said I can’t confidently say that X amount that got an A actually learned A level material or mastery of that material.
GPA has been around since the:usiness for doing is their IU:So that was my inspiration behind that, to be able to say, “You know what? I don’t think a number justifies or equates to learning. I believe having mastery of material to then focus on a pass/fail system, like in the workforce, will best prepare them.” And we’ll probably spend a lot of time on this, but the feedback from students once I got to a point after a couple of semesters of trial and tribulations, has been extremely positive. And we’ve had this, now it’s starting to replicate in other departments and schools within the Kelley School of Business. So for me it was that one inspirational moment that said, “You know what? This is what I can add value to, both Indiana University and the student body, to be able to help support them both inside and outside of the classroom.”
Boz: Okay, so there’s two things that I found really interesting in that.
First-
Sharona: I have a couple also.
Boz: Yeah.
Sharona: So you go first.
Boz: First the industry background. I think you’re the second person that we’ve had on that, had a full, career in industry before coming to education, and that experience really, affected and really shaped how they dealt with assessment and grading. I find that connection really interesting and I would love to explore that more. I don’t know how to, but look at how many people have come from industry and not just a couple years, but had a full career in industry and then came to education, and how many of them end up with some form of alternative grading.
But the other point that I wanted to make is that conversation with the students. I’ve said this many times, my first experience with alternative grading was not just, a few bumps and bruises. It was a disaster. It, it really was. We had no idea really what we were doing but what did change was that conversation with my students. So the first time I did this was actually in, my K-12 setting. And not just at every semester, but we have four times I’ve got to give grades in a semester. And the conversation is always, and this is with pretty much any middle school teacher or high school teacher, when it comes to that grading time, “M- mister, how can I get, three more points?” “How many more points do I need to get to a B?” But that first time, even though it was a disaster, that conversation had changed to, “What do I need to show about descriptive statistics that I haven’t already? What do I need to show about hypothesis testing?” It was about the math, and it was a statistics course, so it was about the statistics and not how many more points. How do I get more points? Can I get extra credit?
Sharona: So I ha- I took something away from your story that I wanna pursue. So I put a pin in the two that Boz mentioned. I wrote them down, but I really wanna go here first, if that’s okay, which is your origin story has its own unique nuances, but there’s common flavors for most of the origin stories, right? Some sort of disconnect with grades, et cetera, et cetera. Then you tried it, you screwed it up, and then eventually this happened. But you did something that I think all of us wished we could have done and we haven’t, which is somehow you went from that to co-authoring with Linda Nilson.
I wanna hear that story. How did you go from, “I tried specs grading and it changed my life,” to, “I’m now an author with the person who kinda kicked off the entire current wave with between her and Susan Blum”? So, what the heck happened there, and how do I replicate it without actually having to write a book? Because I have a podcast ’cause I don’t wanna write a book.
Joe Packowski: Let me start off by saying when I left the industry, I never thought I would co-author a book, right? That to me was not even on my radar, nor was pursuing my EdD. However, what I realized was after I implemented specs grading two, three semesters in one of my main goals as a leader of organizations was I always had a very detailed plan of where I stood. And there, there’s a book by Gleason that’s called The Personal Efficiency Plan, and there’s this other book called The Four Disciplines of Execution, which are both workforce books. But what they talk about is this thing called lead versus lag measures. And lag measures are, hey I’m gonna get data, but it’s too late to impact, kinda like the end of semester student evaluation of teaching. Lead measures are data that you seek that you can impact now. So what I did is I started capturing data through mid-semester surveys because I couldn’t impact the end-of-student evaluation of teaching, right? The course is over, I can’t do anything. So I read some research on doing mid-semester surveys and I started getting feedback from students around the course and around specs grading. And they would provide me details saying, “Hey, it was too confusing up front. Could you spend more time giving examples?” So they gave me some really robust quantitative and qualitative data, and that triggered in my mind that, hey, I need to capture data, right? I had no idea I was pursuing my EdD or anything like that, nor this book.
So I started capturing data on, grade disputes their willingness to engage and empower themselves to actually participate. So all these different data points I started to gather, and when I started doing that, I said, “You know what? I wanna thank Linda for giving me this gift,” right? And part of what I teach is I teach personal professional development courses personal branding, how do you network and then get your value proposition to others in recruiting, emotional intelligence and leading teams. So it all kinda works well within the core structure of what I teach, but I thought that I wanted to thank her. Now, there’s a, there’s some great data by Statista that says less than 1% and this is dated, but it’s still relevant. Less than 1% of emails that we receive are acknowledgments, thank yous, or appreciations.
So I always tell my students, “Hey, if something happens, thank that person. Reach out.” So I just went to LinkedIn, sent her a note and said, “Thank you. Would love to talk to you one day to personally thank you for this.” And she and I connected on Zoom. She replied back, right? Which I thought was super cool. I’m like, man this person’s been so influential. I looked at her background. She is just incredible. She’s a pillar in the community when it comes to all of the work that she’s contributed to. And we had this Zoom and she came across… She, one, she thanked me for reaching out because she told me a lot of academics don’t reach out and say thank you to other academics, right? It’s something she isn’t used to. And I said I’m doing this because you’ve really inspired me to continue this pathway.” And she asked me a lot of questions around, “Hey what do you think about it? What went well? What didn’t go well? Do you have data?” And I said, “Oh, yes, I have a ton of data.”
ancements I’ve made since the:But after those Zooms, and we had a couple of them, she’s “Hey, chew on it for a bit,” right? “Think about it, marinate, have some time on it.” And then when we got back together on another Zoom we both agreed. We said, “Hey, we think we have something here.” And I was able to pursue the IRB through Indiana University to get that exempt status for the research that we did, and we had incredible data that we’ll talk about later on in this, on this pod. But that, that was the inspiration. I just did the old school networking via LinkedIn and started having a wonderful conversation on the positive impact her first edition had on me
Sharona: That’s amazing. That act of thank you has been very influential in my own life because I was in real estate for a while and I had a big coaching company in real estate. It’s called the B- Buffini & Company, and they preach notes, sending thank you notes, contact notes, all kinds of things. And I also saw a book called “A Simple Act of Gratitude,” which was 365 thank yous. I highly recommend that book to anyone who wants to see the power of writing thank you notes. And they don’t have to be physical, they can be emails. So to see it change your life that way is incredible Boz, did I cut you off? Did you have a question to follow up on his story there?
Boz: No, I just that’s absolutely amazing. And anyone that, has been listening to for a while or has been in this community for a while, it’s also not surprising because this community really is so giving and so willing to really share experiences and stuff. It’s absolutely amazing that Linda did that, and it surprises me very little that she did it. I mean- Exactly … and she is she’s been to our grading conference a couple of times, and it is absolutely amazing. I can’t imagine being able to work that closely with, like you said, she’s, she is one of the pillars. If you had a Mount Rushmore of alternative grading, no one could do that without putting Linda up there. Specs grading is one of the major flavors of alternative gradings. Like wh- when we talk about alternative grading there’s really several different ways of doing it. There’s no one right way, but they do line up in these big groups that we call flavors. One of them being, ungrading or collaborative grading, one being standards-based or mastery-based, but the other one is specs, and- … that pretty much traces back directly to her solely.
Sharona: So why don’t you go ahead and describe what was the data that you collected that drove specifications grading 2.0? You mentioned it briefly, but go ahead and share how did you bring in all of these, who did you bring in, and what data did you get other than that original study?
Joe Packowski: So the first thing that I wanted to capture was student satisfaction, right? Outside of the SET, or student evaluation of the teaching I really wanted to add questions to that because as faculty, most of us might have the opportunity to add questions to the student evaluation of teaching or online course questionnaires, whatever happens to be at your institution. So I just started asking questions, quantitative, qualitative, “Did specs grading help you empower and prioritize your learning?” Scale of one to five, right? One low to five high. And then I asked them to share their experience And I also gave them the flexibility back to that lead versus lag measure of giving me feedback mid-semester. What can I do to pivot, right? To make this a little bit clearer and more impactful for your experience.
And what I started to gather data on and one in particular, was roughly four… and this is through about 1,500 students when I asked them this question, “Hey, did Specs in help you empower and prioritize learning over grades and that mindset shift?” The average came out to roughly being around a 4.3 to 4.4 out of 5 that it did, which is extremely positive, right? Especially because this is the first time most of these students are embracing this. And they provided a ton of good qualitative feedback and commentary that they provided, and I had some notes on a couple in particular. Students at the end when I ask them, “Hey, tell me what you think about it.” Like, when I read, and for those listening to the podcast if you’re a teaching faculty member or assisting those that teach, these OCQs can be, difficult to open sometimes, right? You never know what you’re gonna get. And when I opened it and I started reading some of these, here are three in particular that I got during this time where I’m asking for feedback. They said, “I loved it. It truly put me in the driver’s seat of my learning.” ” This class is the first time I’ve really felt completely in control of my future in a course.” And this last one, “I can focus on expanding my skills and knowledge rather than strictly the grade.” So I asked them to shift, basically what I said is prioritize the learning and the grade will follow.
Another data point that I thought was extremely important, so I got a satisfaction score, which is very important, and I got some qualitative feedback. But to me, the biggest thing that shocked me when I came in here as a, as… to teach outside of industry, was what office hours were like, right? I did not expect office hours to be all about point negotiations, right? And, rubrics to me were new. In industry we have key performance indicators. You either meet the metric or not. Here, I would sit down with a student, and when I did traditional points grading, we would look at one area for two points and have a conversation on did that warrant 0.8, 1.1, 1.4? Like I… To me, I was like you either did or you did not, right? There, there really isn’t this, ’cause once you go into the workforce that’s the case, right? It’s either below, meets, or exceeds. All of those conversations, now I’m not gonna say 100%, but the vast majority of my office hours, which I no longer call, I call them student hours, those student hours have drastically changed to about learning. What could I do differently? Quite frankly, some of those now are about networking I’ve had students now sign up. They’re like, “Look, I don’t have any questions about the course. I think I’m in pretty good shape. I need your help with X.” So it, the mindset relationship shift is completely different now.
And one of the most important numbers that I quantified to your question was on the number of students that disputed the earned grade at the end of the course, because specs does follow that same, accreditation where an end grade is gonna be given to the students. But in the second edition of the book what we talked about in particular was some data that I collected up to that point. So in the book, out of 1,386 students that went through specs grading with me, only five of those students disputed their grade, where they had a legitimate conversation need to discuss what happened. Now, since the book was published, obviously I’ve been teaching since then. So through the summer of this year, I’ve now taught 2,517 students within specs grading. And out of 2,517 students, only seven have sought consultation to dispute the grade. That’s 0.28%. Now, for those listening I don’t know how many conversations y’all have during your respective office hours, or if they get escalated up to the dean’s suite i’ve had no student go above my head seeking, additional guidance on a grade that they’ve earned because specs is so clear. And this is one of the major data points that I share with students. I know that change is difficult, but there’s a quote by John C. Maxwell that I use all the time, “Change is inevitable, but growth is optional.” And I tell them that this growth is to enable you now and in the future. And when I share all of these data, and I share how their peers have experienced this, quantitative, qualitative, I can see the sense of, oh, this is different. I’m not sure where I stand, but if 2,517 students are at peace with where they landed, and if four point four out of five is their rating on this empowering their learning, something is going on here, right? There’s something happening here that I might wanna be a part of.
nstituted specs grading since:the original one came out in:Joe Packowski: Certainly. A couple of things. The first thing is when you look at the cover of the book, Linda had three pillars on our first book, right? Restoring riter- rigor, motivating students, and saving faculty time. What we brought into the equation now, back to your earlier comment, is we’re looking at this from a holistic lens academia and industry. So the fourth pillar, which is new in the second edition, is developing the career competencies of students. So we spend time going into more detail in chapters on how Specs grading can help support competencies and skill sets sought after by employers. So we have a lot of data from the National Association of Colleges Employers, intelligent.com, Forbes, Boston Consulting Group. So we’re bringing in both research from academia as well as the workforce and industry to complement how we best support the transition of students to industry. So that’s one of the major enhancements to the second edition.
The second thing is the first edition was a pilot, right? They piloted this with a number of just over a dozen or so faculty from Clemson where they wanted to see how this would go. The second edition, and I think and Linda and I talked about this, because a pilot wasn’t as robust, this second edition now includes 21 respondents across the globe who share their perspectives on how did they find out about Specs grading? How did they institute it? What’s their feedback on the employability skills that students get once they do go through Specs grading? And what is the student perception? So we’ve now had data from t- 21 different respondents through that survey over 100 different courses. So we went from a pilot to now expanding this, and we had people from East Asia, Canada, and the UK actually participate. So this is more of a global sense. And it also included a variety of the STEM and social sciences, which didn’t really happen in the first edition, which was more of a pilot. So we increased the discipline, we increased the modality of being both in-person and asynchronous, but we also now have actual data, right? Actual data from users that have had a chance to experience this over an extended period of time.
And what I believe is incredibly important in the second edition is that we provide a roadmap for folks that are interested in alternative grading, and hopefully within specs grading, on how you can start depending on where you wanna go. Do you wanna start with maybe just one assignment? Do you wanna do a hybrid approach? What pathway do you wanna go down? And we illustrate various rubrics, various assessments, strategies on how we implemented that, again, across different disciplines and modalities. So this one is more around, “Hey, I’m interested. How do I do this? What is a potential roadmap for me to consider?” So the first edition was a really good foundation as to the why. The second edition is now expanding upon that in terms of what’s next and how is this important to me if I’m interested in implementing that, depending on my discipline and the modality.
Boz: See, so I’ll admit, and I said this to you before we jumped on recording, but I have not yet read this book. It is, on my to, to read list, but I have not yet had a chance to read it. But I have read, some summaries and some other things about it. And like you were saying, this has I think four or five new chapters that really are not the why, but the how. The actually- Correct … looking at those does… In fact, one thing I s- I read said it’s firsthand accounts of dozens of instructors, not just from multiple disciplines, but also from multiple environments around the world. But it’s really got this how to, and that’s one of the things that There are lots of great why books out there now, going all the way back to Guskey’s– Or not Guskey’s, but Blum’s Mastery Learning in the ’60s. There’s lots of the whys and explaining the big picture and what’s wrong with traditional grading. There’s only a handful of the hows that really get into the nuts and bolts, and it looks th-these five new chapters in this book gets into that, gets into some of the nuts and bolts, the hows, and you were saying it has different entry points. It’s okay if you just wanna do, the– not an entire redesign of your whole course, but you wanna do it a little here or…
So I love that. The how-tos we need more of those out there. There’s lots of whys. We need concrete how to really help people get started. So we’re not making as many mistakes as me and Sharona did, as it sound like you made some of them on your one too.
Sharona: And not just how-tos, but also exemplars, right? We always tell our students or we tell faculty that we’re trying to train, “You should give your students a good exemplar if you can,” right? So that they can have something to model. And I think that the more that we as faculty who work with faculty can model the same thing. So I was looking through chapter seven of the book, which is course designs in STEM and the health sciences, and I’m looking at the topics, right? And there’s examples in mathematics, there’s examples in biological sciences, there’s examples in general chemistry, chemical biology, organic chemistry at all kinds of different levels and engineering physics, thermodynamics, nutrition in health promotion and disease prevention. So we’ve got– These are actual exemplars with- … actual lists of st-students who are earning an A is gonna get this, is gonna get that. How did that chapter come about? Like how did you decide to include the exemplars?
Joe Packowski: So when Linda and I had those Zooms, right? Initially the first Zoom I thought was just gonna be transactional, right? Thank you, nice to meet you you’ve been very influential. It was far from that. It was transformational. We started to have conversations around impact, right? Impact on faculty, impact on students, impact on others. And when she reflected back on her first book, she was very adamant about saying, “Hey, it was a pilot,” right? We wanted to get this out there. But as she started looking at different research articles and literature and videos and everything else, it opened our eyes to, hey, other people are using this, right? Other people are having successes, failures but a lot of best practices that they can share with others.
And when we started thinking about this and working with Routledge on the chapter and the outline, we said, “You know what? If somebody is to pick this up that might be in discipline X, we wanna be able to at least capture as much as we can.” You can’t capture everything, but between the STEM and social science and going through the, those exemplars and saying, “Hey, you might fit into X.” And the beauty behind Specs Grading, in my opinion, is it’s not cookie cut, right? There are so many different ways that people can embrace this. It’s foundational, but it’s almost like you can have a Jenga. You might take this block and move it here, but depending on your situation and your pedagogical principles, you can take this in so many different directions.
So giving examples like that, which was a byproduct of our conversations around how can we best provide this as a roadmap for folks that they can jump into the short end or the deep end of the pool, depending on where they’re at, but we want them to have a home, right? If the home is in chapter seven, chapter eight, to be able to go to and say, “Hey, I’m chemistry,” or, “I’m social sciences, I’m language,” whatever that is, you can fit into that mold. But by the way, you can also look at what others are doing, and that’s the beauty that hopefully we’ll be able to talk about, is the importance of collaboration and networking in this alternative grading community. Because I’ve talked to peers where I’ve learned something and I said, “Hey, that is absolutely brilliant. May I use that?” And I think that’s the thing. It… There’s no end result to this. So the whole thing to me is the Zoom went from transactional to transformational to now providing a plethora of options for folks to consider.
Sharona: That’s incredible. And I do wanna mention, you mentioned chapter eight. So chapter seven was a lot of the STEM courses, and chapter eight says “Specs Graded course designs in business, the humanities, and social sciences.” So for all of our listeners, there’s something for everyone in this book, and I love that. So I do wanna follow up then, you gave me such a great opening on the networking. So do we wanna go in that direction more, is there something else you wanted to say before we move into the networking part of the conversation?
Joe Packowski: Yeah. The last thing on networking that and Linda shared this with me, and I’m perfectly comfortable and I believe she’s comfortable with me sharing this too. We’ve continued this networking since that first Zoom almost three years ago. Almost every month or a month and a half, she and I get together and talk. Sometimes it’s about new opportunities. She and I are thinking about a couple different articles that we might wanna go together. I don’t think she’s ever gonna stop we always talk about things. But I asked her and I told her, I said, she is a true mentor to me.” So just because we did this together it’s not over. We’re constantly in contact and to me that, that… Again, you’re gonna hear me say transaction versus transformational. This experience has blossomed to the point where she and I talk continuously. Sometimes it’s about life, sometimes it’s about academics, but I think the importance is don’t end on a note that you have a product. Continue that ’cause you never know what the next step can yield.
Boz: That’s amazing. That is, again I can’t imagine h- how that kind of relationsh- having that with someone w- at the level of Linda this just amazes me. I’m so jealous.
Sharona: It’s- and the- Exactly … fact that when we invite people to come on the pod, we invite people like you who are some- a little bit newer and may not have the name, but then also we had Thomas Guskey on here, which I floored Bosley- … with people know. And then we’ve had, we’ve had Robert Talbot of course on, and David Clarke, and we’re actually… i’ll give a little sneak peek. We do have an interview scheduled with Linda that’ll be coming out soon, and we’re gonna be talking To Susan Blum in the near future. But I really like that idea. That’s why we formed the Center for Grading Reform, is we felt like this crossed all institutional boundaries, it crossed all states, it crossed all countries, it crossed all disciplines, so we’re trying to be that network. And I love what you said about the fact you guys still talk. Bosley, I think we need to just do a casual monthly Zoom lunch and learn or something, or BYOB if we wanna do it in the evening. The problem we have is it’s really hard because we’ve got people from Australia to Germany that are… the conference, we have people that are presenting from Germany at 9:00 at night, and then we had people from Australia who got up at 5:00 in the morning. ‘Cause, we do all of our times around sort of an Eastern time zone- … schedule, even though all of the employees of the center are in California.
Joe Packowski: And one, one funny, fun and final story on this. So this whole thing with the second edition happened virtually. We never met in person, right? So there was a chance where Linda was gonna present something at a Lilly Teaching conference in Akron, Ohio, and I said, “I wanna come. I wanna meet you,” right? So our first time as we were going through this together, we actually met. And the funny thing is we’re about two feet different in height. I’m six foot five. So the first time we met, it was so funny. We embraced, and then it blossomed to the point where I went to another Lilly Teaching conference in Asheville, North Carolina, and I said, “Hey, you’re in South Carolina. Do you wanna meet my wife for dinner?” And we did. So this has just blossomed to an incredibly powerful relationship that now we have, and both our spouses had a chance to meet each other. It’s it’s just a beautiful thing.
Sharona: Speaking of which, I meant to tell you we’re gonna be at JMM, the Joint Math Meetings in Chicago in January. So Drew and I are gonna be there. Bosley, I’m not so sure we’re gonna get him there. But if you wanna drive up to Chicago we’re gonna have eight hours of talks on alternative grading at the- There we go … Joint Math Meetings. So I dunno how far Chicago is. I don’t think it’s very far.
Joe Packowski: I’m gonna mark that down, ’cause I know we talked about that.
Sharona: Yeah. So, yeah, our folks in the math world, we’re gonna be having some sessions at the Joint Math Meetings, which is pretty exciting. So in terms of networking, and given your experience in industry, what types of structures should we, the center, or we, the members of the alternative grading community, start to try to build? We have the Slack, and it’s there, but it has some limitations because we can’t afford to pay for the professional version. We just, we don’t have the money. What would you recommend from your perspective of building networks? What types of networks should we be looking at and how should they be held?
Joe Packowski: So, having conferences is extremely important. Some folks might see something for the second or third time. For others, it might be the first time. So the first thing is continue down that annual conference that y’all have to get visibility out there to, to the members to be able to view. The second thing for me and this is where I believe SPECS really took off at Indiana University, is having a faculty learning community of like-minded folks that want to embrace the process, and then be able to present their findings at teaching conferences. I’ve had a chance to talk about SPECS grading at that Lilly Teaching Conference that I mentioned. I also did it at the Management and Organizational Behavior Teaching Society teaching conference. But I did that solo because I didn’t know of the network, and a lot of these happened before Linda and I started to engage. So I think there is an incredible opportunity for like-minded individuals to get together on a proposal at these and there’s a ton of teaching conferences, as we all know that welcome not just the AI side, but also what else can we do to complement student success and faculty development.
So I think those faculty learning communities and teaching conferences is another area. And then the third one to me and this has been probably the most powerful evidence that I’ve had outside of the two data points that I talked to previously. Existing and former student testimonials are critically important to help other students or newer students embrace this system. Every semester now we use Canvas for our learning management system. If there is a way where we can get former students to share open and honestly their experience, and as an example, in my Canvas LMS, I have students on an alternative or an optional assignment do what I call a legacy learning video, where they get together and they share their experience of the course and specs grading for other students to see. You open Canvas on the homepage, yeah, you have me and my picture, my intro video, but then you have former students.
I always hire a former student as my upcoming teaching assistant, because students relate to students differently, right? They get up there and they share their own videos. So I think the more that we have an opportunity for folks to see these videos, and obviously you have to seek permission and follow the guidelines of institutions, but to me, having those students, either in written or video format for others to see, like that is, to me, the ultimate impact. Did the student embrace that? So I think those three in particular, if there’s a way that we can continue down that pathway if I had to prioritize that, I think that faculty learning community of like-minded individuals working on proposals across all of these various teaching conferences, including the Grading conference, would be an incredible opportunity for consideration.
Boz: I was gonna say, I l- I love the point about the students, because you’re right. Students do engage a- and just learn from each other differently than they do from us. You can be the world’s greatest instructor, students are still gonna react and respond and learn from other students in a different way. And I know that’s a practice I’ve done in my high school, regardless of grading. One of my end assignments was always write a letter to next year’s students. What did you wish you knew about the subject, my teaching this class? So I love that idea, and I agree. I think that is an incredibly powerful thing to do if you’re able to do it. I’ve never thought about the videos. I’m gonna have to figure out how to try to incorporate that in the future.
Joe Packowski: Yeah, they’re just vignettes, Boz. They I talk to students, and for those on the podcast that, that teach or support teaching, when a student opens up their course in whatever learning management system it is, when I ask them, “Where do you go?” The first thing is the syllabus, and then the second thing is the homepage. That, that is invariably where they go. But what I’ve done now is I literally on the homepage have item one, two, three, and four. One is a welcome, two is my intro video. I’m talking a three to four-minute vignette so they can see me in advance of the class. The third is I go through some resources they should probably look at prior to our first course. And then the last one is, here’s what former students have said, right? About the course and about our innovative grading strategy.
And those vignettes, and it’s just so cool. They’re from the heart. I give them the guardrails. I don’t tell them what lane to drive in. I said, “Hey, just make sure you, you talk about these points.” It is totally them. And the feedback and I love watching them and there’s data and analytics we can look at to see how many students actually view it. But they come to class seeing me, seeing their peers, and getting a flavor before the class even starts. They just send an MP4 or MOV video and I upload it to Canvas, making sure it’s accessible. But yeah, it’s a very powerful resource
Sharona: And then one thing I wanted to call out that you said about the teaching conferences we do have a request out to everyone who’s listening. We put this request out at the conference as well. We are trying to build our resources here at the center including financial resources and things, but one of the things that we wanna do is support people who wanna go to these teaching conferences and either present or they’d like us to be at those teaching conferences and present because we have, mini courses designed. We can help organize speaker sessions. So if you know of a conference, a disciplinary-based or a teaching conference that you think that alternative grading should be represented at, we are happy to help spearhead that opportunity. Many of us are disciplinarily, we’re in math, so we’re going to MathFest, and I’m going to MathFest in August. We’re at the joint math meetings. We’re waiting to hear from POD right now which is the Professional Development Network. And I have historically gone to ASEE, which is the American Society for Engineering Education. I’ve also been asked to present at one of the teaching conferences for ASBMB, which is the American Society for Biology and Molecular Biology. But we would love to be at other disciplinary conferences, DBUR conferences, teaching conferences. So give us a list, and if you would be willing to present there, we will see if we can help support that, either financially or logistically, whatever we can do.
Because that is part of our mission, is to cause systemic change or be working towards systemic change at this massive level. We’re not thinking small here. We might be crazy, but we’re not thinking small. So where do you go from here? What are your next steps? So you’re still teaching, you got your EdD, but what’s next on your plate with all this stuff?
Joe Packowski: So the business side of me comes out from the corporate experience, so I have a short and a long-term plan. So my short-term plan was to be considered for promotion here at Indiana University in the Kelley School of Business, and I just received last month the notification from the board of trustees that promotion is going to be… it is effective now July 1st. So my first thing was now I’m a senior lecturer, so that was my first short-term goal was to be recognized, and I’m very grateful for that opportunity. My next two steps involve continuing my EdD in instructional systems and technology at the School of Ed here at Indiana University because I want to further dive into what happens behind the scenes to best support student success, and a lot of that is on course design and assessment and how do we best support student development inside and beyond the classroom. So that, that is more of my long-term play. Being full-time and pursuing your terminal degree takes some time, so I’m perfectly fine with that.
But my third step in that series is I want to continue to spread the news of innovative grading strategies. We’ve had a chance to have faculty learning communities at IU on specs grading specifically. We’re introducing some various internal websites to be able to support folks at the Kelley School of Business when it comes to specs grading. But I believe there’s other ways that we can continue to get the word out there. As an example for those listening, we’re gonna start elevating our LinkedIn account that we have specifically to specifications grading, so if anybody’s on LinkedIn here, please follow that because we’re posting a lot of success stories and articles specific to specs grading.
And we’re getting to the point in the bigger vision I have outside of that, like my three to five year, what I’m looking to do is to start having conversations with students who have gone through specs grading and are now in the workforce. Did the promise of what we said in the classroom actually play out? Because employers, and a quick side story on this one as we start continuing to seek that possibility of interviewing students who are now in the workforce. We have various calls with employers as part of our core structure for one of our courses that we teach, and we engage with recruiters who come to campus seeking talent at the Kelley School of Business, and during those virtual conversations with employers and students, I ask them, “Hey, we’re doing an innovative strategy called specs grading. Let me describe,” and I give them some details in advance. And I ask them, again, similar to how students can influence students differently, they listen to recruiters like 10 times more than they do me, right? It just is what it is, and I understand that as a former recruiter. But I ask them, “Hey if a student experienced this,” because specs replicates the annual performance review process in the workforce, literally below meets and exceeds, “how would that differentiate a student knowing that they had that experience in terms of how they will acclimate to your company?”
And overwhelmingly, it’s positively received by the employers. They said, “Hey that’s something that’s innovative. That’s something that obviously they’re gonna be a part of.” So I want to be able to now next stage, talk to students in the workforce and say, “Hey, did this prepare you? What is some feedback? What could we do differently? Did this actually promise what we talked about when it happened?” So I have a lot of things in the works right now to be able to continue to share the wonderful successes that SPECS have both inside and beyond.
Boz: Okay, so, if you ever meet that last goal, like you gotta reach out to us and let us know.
Being in education, being a department chair at my high school for as long as I was being in a intervention support coordinator role as long as I was, and just being, Sharona’s thought partner as she was a coordinator, in education we’re always looking and evaluating data And most of the time, I think it’s the wrong data. One of the big things that, Sharona and I have talked a lot about especially this time last year was, our DFW rates. The institute that she and I teach at they were really focused on DFW rates and those kind of immediate things like that, that I’m like, “That’s the wrong metric. That is not what we need to be looking at.” We need to be looking at following course success. How does being in one of these types of classes affect, their calc two, calc three experience or- … other educational experiences. Taking that a step further and now looking at how does that affect their, life outside of academia and actually in career, if you’re able to pull that, I would love to see that data. I think that would be an ultimate, judgment point of just how well alternative, whether it’s specifically specs or any other alternative grading, how that actually affects. Because I th- I personally think it, it would be really telling. And for someone like myself and all the excuses I get about, real world, oh, this isn’t how things are done in the real… I would love that data just to be able to show, yeah, that no, this is how things work in the real world, and yes, this is, the benefits of doing this compared to traditional grading. I think that would be amazing to see.
Joe Packowski: Yeah, and Boz, that goes back to your other question a while back about what’s different about the second edition. We’re opening this book to so many different stakeholders, right? Recruiters, employers family members, students, obviously faculty and administration, because the ultimate goal is to help support the student getting a job, right? And once they get that job, they make an impact on day one. And we’re just giving them these foundational skills because they can’t go in there expecting a 82.6. It just doesn’t exist.
So to me, having that information and data, and I’m now at the point, since I’ve been doing this in the spring of ’22, I now have the first wave or so of folks actually in the workforce. And back to that dispute, like I, I have all the students that, that have gone through this with me, so there, it’s gonna be a labor of love. But to me, to be able to see did X equate to Y, th- that’s the next step
Sharona: And I’m really interested to see what happens in the broader world as well, because we are seeing, like we’re noticing in Canada, that some of the accreditation agencies are going to this competency style of accreditation. And so people have started to look at competency-based assessment, but yet going the step to grading is still a shock to people. So we’re starting to promote that and work with that. And so I love the fact that you say career competency in this book, but you’re already there on the grading side, the grading of the competency. So seeing how that translates into that real world and, do they actually have the competencies that we claim that they’re gonna have coming out of our programs?
Joe Packowski: And that’s such an important point that you make because the other thing that I continuously reinforce to myself and hope that the students embrace is that the GPA will follow your learning. But it’s a mindset shift to go into there to tell students, “Do not focus on GPA.” The book, we spend a lot of time talking about data from the National Association of Colleges Employers, NACE. GPA isn’t the most sought after attribute they’re looking for. It’s skills. It’s experiential learning. So we try to have them have this mindset shift. Your GPA will follow. If you invest accordingly, focus on your learning, focus on progress not perfection, make sure you look at the student learning outcomes, like it’s outcomes-based. But when they do that, the grade naturally follows. And but that’s a very difficult since kindergarten, right? With all due respect to all the different type of environments and institutions, for the most part, it’s been a letter grade, right? You must maximize X, and X is always points, not learning. We need to make the shift away from maximizing points to maximizing learning, and the GPA will follow that learning.
Sharona: But the key there is they have to trust you because they’ve been trained not to trust you-
Joe Packowski: No question. …
Sharona: That what you’re saying is correct, because there’ve been too many instances where they’ve been given gotchas. So we have to acknowledge that it’s not just that students can’t understand it, it’s not just that it’s a mindset shift, but there’s a trust deficit with instructors. And so we’re fighting that too and the more that we can communicate that, and the more that students can start to trust us that we mean what we say, yes, you’re correct, the grades will follow, the GPA will follow, but only if the systems are designed to actually allow that to happen.
Boz: I cannot believe that our time is already coming up. Before I get to you, Joe, Sharona, is there any other last-minute questions or things that you wanted to bring up?
Sharona: No, I think that, I followed the threads that I wanted to follow through the conversation. Other than we could probably do this for another five hours- yeah
and I’m sure we will over the next few years, but.
Boz: All right, so Joe, is there any other last minute big points that you haven’t been able to get in yet that you wanna leave with?
Joe Packowski: So for those listening I was there four years ago. The semester starts, you click on publish. You’re not sure what to expect with students. You’re dreading office hours. You’re anticipating conversations on point negotiations. You’re not sure if the students are going to embrace and prioritize their learning. If any of those questions or scenarios come into play Linda and I would welcome and invite you to consider Specs Grading 2.0. It gives you faculty time back to focus on adapting your your course design and the way that you engage with your students, and you get to have more rich and robust conversations on learning. If some of those benefits and minimizing to mitigating grade disputes are something you’re interested in we welcome. There’s a lot of great alternative grading strategies out there. Linda and I believe that Specs Grading 2.0 helps support you and in the, from a faculty perspective. But more importantly, when it comes to the student success, their preparation inside and beyond the classroom. So we invite you to consider it and see if it aligns to your pedagogical principles.
Sharona: And there will be links in the show notes to the book and the LinkedIn page
Boz: Yeah I was about to ask. I- if someone did want to learn more about specs grading or the book or about you and any of your other projects other than, looking up Amazon or links to the book and the LinkedIn, is there any other platforms or any other places that they should go?
Joe Packowski: Yeah, so those are the main ones right now. For LinkedIn, I get all those messages, Linda and I, but I’ve had faculty actually reach out to me because as a public university my contact information for my email is out there, right? Joepack@iu.edu, and I’ve had folks reach out to me and consider book clubs and other conversations that they wanna have. So we always welcome the conversation to help support alternative grading and the Center for Grading Reform.
Boz: I want to thank you so much again for taking some time out to, spend an hour with us. And to our listeners you’ve been listening to The Grading Pod with Boz and Sharona, and we’ll see you next week.
Sharona: Please share your thoughts and comments about this episode by commenting on this episode’s page on our website, http://www.thegradingpod.com. Or you can share with us publicly on Twitter, Facebook, or Instagram. If you would like to suggest a future topic for the show or would like to be considered as a potential guest for the show, please use the Contact Us form on our website. The Grading Podcast is created and produced by Robert Bosley and Sharona Krinsky. The full transcript of this episode is available on our website.
Boz: The views expressed here are those of the host and our guest. These views are not necessarily endorsed by the Cal State system or by the Los Angeles Unified School District

Leave a Reply