50 – How we quadrupled our pass rate: Lessons learned from Redesigning Precalculus, An Interview with Dr. Latrice Bowman

In this episode, Sharona and Bosley speak with Dr. Latrice Bowman, a mathematics faculty member from the University of Alaska, Fairbanks. Latrice took the MAA OPEN intensive training on redesigning a course to use alternative grading and is back to talk about her first two times running the redesigned course. She shares lessons learned and changes made. We talk about reducing the number of learning outcomes, progress tracking, students conferences and so much more. Oh – and the result? A quadrupling of the pass rate from pre-calculus through first semester calculus.This is another great example of the process of course redesign.

Links

Please note – any books linked here are likely Amazon Associates links. Clicking on them and purchasing through them helps support the show. Thanks for your support!

Resources

The Grading Conference – an annual, online conference exploring Alternative Grading in Higher Education & K-12.

Some great resources to educate yourself about Alternative Grading:

Recommended Books on Alternative Grading (Please note – any books linked here are likely Amazon Associates links. Purchasing through them helps support the show. Thanks for your support!):

The Grading Podcast publishes every week on Tuesday at 4 AM Pacific time, so be sure to subscribe and get notified of each new episode. You can follow us on Twitter, Facebook and Instagram – @thegradingpod. To leave us a comment, please go to our website: http://www.thegradingpod.com and leave a comment on this episode’s page.

If you would like to be considered to be a guest on this show, please reach out using the Contact Us form on our website, www.thegradingpod.com.

All content of this podcast and website are solely the opinions of the hosts and guests and do not necessarily represent the views of California State University Los Angeles or the Los Angeles Unified School District.

Music

Country Rock performed by Lite Saturation

Country Rock by Lite Saturation is licensed under a Attribution-NonCommercial-NoDerivatives 4.0 International License.

Transcript

50 – Dr. Bowman

===

Dr. Bowman: She was a student, a non traditional student, hadn’t seen math in probably 15 years, which is always a red flag for me because I’m like, Oh, no, it’s a lot of coming back. And she struggled at the beginning. And she was like, I’ve never seen mastery before. I haven’t seen math in 15 years. I don’t remember half this pre Calc, so she was relearning a lot of that algebra stuff we were talking about. And halfway through, she was probably my best student because she was like, it’s not that I don’t remember the math, I forgot how to study. And she’s like, having these retakes, having you give us feedback and me looking at this like, oh, okay, that’s what I’m missing. Or, oh my goodness, this is a silly mistake. And having those retakes, she said, was the thing that brought her back, and she ended up the class with an A.

Boz: Welcome to the Grading Podcast, where we’ll take a critical lens to the methods of assessing students learning, from traditional grading to alternative methods of grading. We’ll look at how grades impact our classrooms and our students success. I’m Robert Bosley, a high school math teacher, instructional coach, intervention specialist, and instructional designer in the Los Angeles Unified School District and with Cal State LA.

Sharona: And I’m Sharona Krinsky, a math instructor at Cal State Los Angeles, faculty coach, and instructional designer. Whether you work in higher ed of in K 12, whatever your discipline is, whether you are a teacher, a coach, or an administrator, this podcast is for you. Each week, you will get the practical, detailed information you need to be able to actually implement effective grading practices in your class and at your institution.

Boz: Hello and welcome back to the podcast. I’m Robert Bosley, one of your two co hosts, and with me as always, Sharona Krinsky. How are you doing today, Sharona?

Sharona: I’m doing well. Often at this point I tell you about what’s going on with my schooling, but I’m actually going to switch topics because I got to see my son in his first professional theater production. So I watched six hours of Fiddler on the Roof yesterday. Saw the show twice and shout out to his group, they did a phenomenal job. So I’m enjoying that piece of it. A little bit different. How about you, Boz?

Boz: Well, at the time of this recording, we’re about to wrap up our semester. Like this is our last full week. By the time this actually comes out, it will probably be a couple weeks into my summer break, but yeah, I’m finally at that end of the tunnel.

Sharona: That’s awesome. And with us today in the studio, in the virtual recording studio, we have Dr. Latrice Bowman. Latrice works at the University of Alaska, Fairbanks. So one of the strangest things about setting up this recording session is those of us in California are not used to thinking of people having time zones where if it’s 6:30 here, it’s not later, it’s earlier. So that was interesting. I kind of like that. And you’re an associate professor of mathematics. We met through the MAA open math project. So I’m really excited. Latrice has been teaching about 26 years, all levels of math. So welcome Latrice.

Dr. Bowman: Hello, it’s nice to be here.

Boz: So one of the things we always like to ask our guests the first time that they’ve come on is just kind of your origin story. How did you get into this crazy world of alternative grading?

Dr. Bowman: Yeah. So I guess my origin story starts back with a pre calc class that we had designed. Me and one other faculty member were trying to improve the pass rates on the class. And we had an idea about trying to do something more mastery based. And I will say we went in without a lot of knowledge. And no prior experience and it was a complete disaster. And so we had decided we wanted to try it again. Over the last couple of years, I had been thinking about this a lot and saw that the MAA had a workshop on mastery grading. And I said, well, what’s a better way to learn a little bit more than go to one of these workshops and hear what other people are doing and get some more information. And so that’s kind of where we started out. And this past year, so last fall and last this past spring, we jumped right in after taking that workshop and implementing some of the things we learned. We did our precalc class and I think it was a great success. And this summer, our summer session has already started, I’m actually using that mastery grading in the classes I’m teaching this summer as well. So it’s just been a lot of information. A lot of progress. And I think it’s been working out pretty well for us.

Boz: Yeah. You would be surprised how many people we’ve talked to, including ourselves that, yeah, that first year, that first attempt, usually not the best experience. I mean, I think I know maybe two people that were actually successful the very first time they tried to do this.

Sharona: Well, and to clarify that training workshop that you took is the one that we ran. So we actually have spent about 30 hours talking to you and working with you on that. So can you tell us a little bit more about what you remember, what you took away from that initial training and that made you excited to try it? And then tell us a little bit more about that first experience.

Dr. Bowman: Okay. So I think the training just helped us realize that we needed a little more in thought put into it. So it’s not just taking a class and saying, okay, I’m going to make it mastery. It’s actually thinking about all of the different things you want the students to actually be able to do. And I think we did that, but we didn’t have it concrete enough for the students to understand, or for us to be able to say, okay, yeah, you’ve actually met that goal. And so putting that into a little bit more of a concrete picture and overall structure was one of the biggest things for us. The other was, kind of reducing what we wanted them to do. So we had originally just taken our course and said, Oh, okay, there are 42 lessons in this course. We’re just going to have you master X number of those 42 and keep going from there and we realized that was way too much. And in order for them to actually be able to master it, they needed the time to go back and think about it to go back and look at the feedback and and reassess themselves before they could try another attempt. And we didn’t really have that built in that first time around. And so reducing the number of lessons and I’m not saying content. I really don’t mean we change the content. We’re still teaching the same content, but the, the actual number of learning objectives that we had reduced greatly. So we, we only cut them in half, but it’s still a lot.

Sharona: Can you give people a concrete example? Because, we get this a lot. We tell them our best recommendation is no more than 30 learning outcomes. I know people who have done more, so there’s no one true way, one right way. But can you give an example of something that got cut down in terms of the actual objective, but yet is still taught.

Dr. Bowman: So, I, I will start early on in pre calc. There is a whole section of kind of, well, at least for us we were using the Hawkes learning book, and it starts out with like an algebra review. And so there’s a whole thing on, you know, real numbers and all of the properties of real numbers, and then it goes into linear equations and all the different ways you can solve linear equations and quadratics and, you know, rational, all those, those kind of basic things you get before you even get to functions. And for us, we had actually started with that material and said, okay, we’re going to have learning outcomes for each of those things. And what we found is that’s not really the content we wanted, right? Yes, they need to be able to solve linear equations, but I want them to be able to solve that in the context of something later on. And all of those real number properties, I’m not going to sit there and ask a student, hey, can you tell me what the commutative property of addition is? Not in a pre calc class, in an algebra class maybe, but in pre calc, I want you to be more understanding of the fact that I can take two numbers and add them together, and it doesn’t matter the order. I don’t care that you know the name of that property.

So there were things that we left in there, and we’re going to cover it, and talk about it, but I’m not going to assess you on that anymore. Whereas Quadratic equations that’s something you’re definitely going to need. And yeah, there’s different ways you can solve quadratics. I’m not going to test you necessarily on each one. Maybe I give you two quadratics and say, solve this two different ways. Right. So they’re still showing me they can learn that content without me giving them four different learning outcomes on it right. So, we were trying to condense the number of learning outcomes in that sense with the things that, yeah, do you have this skill and can you show this without doing it over and over and over with every little thing? I don’t know if that makes sense.

Boz: Absolutely. I’ve the last time I taught algebra two in my high school setting. I did something similar where traditionally that Algebra 2 class, the whole first two units is Algebra 1 review. And we wasted a good chunk of time teaching and testing. And I’m like, yeah, you know what, I’m going to put some of this on things like Khan Academy or Desmos and this is asynchronous. If I see you’re struggling, I can jump in and help. But yeah, I’m not utilizing this time because there’s so much in, you know, especially a high school setting. There’s so many state standards and common core standards were supposed to do. I can’t waste that much of my first semester, you know, doing stuff that they should already know. And even if they don’t, we’re going to revisit later on in other contexts. So, if they don’t quite have all their linear function skills when we’re doing statistics, I can, I can hit it there, you know, I don’t have to go back and reteach, okay y equals mx plus b. This is what it means. This is how you graph, which, for the first, you know, 15 years of my career, I’d always taught algebra two at least once, every single time we did that.

Sharona: And well, and the problem with it is beyond just the time is the students begin to lose the forest for the trees when you’re so focused on every standard algorithm and, and micromanaging those algebra skills, they lose track of functions. The concept of a function disappears into this symbol manipulation. And I really think that for me, because I’ve taught that one semester six unit pre calculus course, it’s an entire year. It’s both trigonometry and functions. So it’s like college algebra and trig combined. And it’s hellacious in terms of the amount of quantity.

So, and when you do that and when they lose those conceptual pieces, they go on to calculus and they don’t succeed. So I really do think and a call out to all those math professors out there, we need a national conversation that really takes root into pre calculus and calculus at the university and say what really belongs in that. And I kind of feel like we’re getting it through the back door with the grading. Right. So I’d love to hear that you have that experience.

Dr. Bowman: I was going to say one other thing was that I did take something away that you had done, which was, there were also these other I don’t remember what you called them, but they, they weren’t content standards. They were kind of the

Sharona: Mathematical practice standards.

Dr. Bowman: So we did three of them because one of the things we always found from our pre calc students going into calculus was either they didn’t know how to simplify things or they had trouble. Like we’d get a graph and it would just be this picture with no labels for axes or no units or, you know, just kind of this arbitrary thing. And we’re like, what is this? So we put some of those early algebraic skills into these three standards. We called them algebra one, two, and three. And it was being able to simplify your expressions correctly. Being able to set up and label your graph correctly. And then being able to use an appropriate method. Because sometimes there are other ways to solve things, but if I’m asking you specifically to use something, can you do it that way? And so we put those as three standards that we just put on every quiz. And so you got a score for the actual outcome, and then a score for how well did you do this? This is something we can work on outside of the content.

Sharona: I was just going to ask the question about, you’re talking about pre calculus. What is your institutional context? Cause I forgot to ask that at the beginning. Can you describe your university and the type of students who are taking this class?

Dr. Bowman: Yeah. So we are a four year public institution. We are not R1 yet. We are actually in the process of becoming R1. But we do serve we have a whole undergraduate and graduate program in most of our different departments. We have a big rural. component to our campus. So Fairbanks is kind of right in the center of Alaska, and I’d say we probably have about 7, 000 on ground students right there in Fairbanks. We have a couple of neighboring towns where students will travel in, and it can be up to a two hour drive either way. But we get a lot of students who are over 300 miles away from us.

And so we have a large online component. We often have all of our courses that we offer in person. We offer an asynchronous section as well. Often we’ll have kind of synchronous video sessions. For some of the classes, but we almost always for our math classes have an in person and an asynchronous because we have those students who just can’t make it to campus. We do also get a lot of students overseas, because we have a military base and a post and Anchorage, which is about 300 miles away, also has a post and we get a lot of military students who are. stationed in Germany or stationed in Afghanistan or, you know, wherever. And so we’re getting a lot of them taking our classes too. So a lot of kind of spread out.

Sharona: And did that predate the pandemic, the asynchronous?

Dr. Bowman: Yeah.

Sharona: Oh, interesting.

classes asynchronously since:

Boz: I was about to say, that’s the, you are by far the first and only person we’ve ever talked to that that said that at all. So that’s that is very unique. Now you have so many people taking asynchronous and online. Is that just because of the distance? Or is that also because of some of the extreme weather that I know parts of Alaska gets? I’ve watched Ice Road Truckers.

Dr. Bowman: I honestly can’t answer that truthfully. I don’t know. I mean, we have a lot of students who come to Alaska just because it’s an experience. And I don’t know how many students I get that are from Hawaii and California and all these nice warm places that come up. in the winter. And they take the in person classes. So they’re walking campus in the winter. So I, yeah, I don’t know.

Sharona: My son, little side note, my son, older one, is doing a military ROTC right now. And he is going to be visiting Alaska for a couple of weeks for some cadet training this summer. And he really wants to get posted to Alaska. And I’m looking at him going, you’re a Los Angeles kid. I’m so confused. But he’s in Green Bay, Wisconsin right now and loving it. So there you go.

Dr. Bowman: Yeah. It’s a, it’s a bucket list item for a lot of people. And .

Boz: It is for me. That’s out of like all of my bucket list. It’s the only really the only bucket list that’s in America. Like, I’ve heard so many things about Alaska and especially some of the unbelievable fishing and just the outdoor. I would love, love, love, love to be able to go up there.

Dr. Bowman: No, it’s, it’s great.

Boz: So I did want to ask kind of going back, when you were talking about the MAA course, you, you kept saying we, did you and your partner that you were redesigning the course do the course? Cause I just remember it being you.

Dr. Bowman: So no, I, I did it. She was actually working on a calculus project that I won’t go too far into, but we’ve been kind of redesigning our. For lack of a better word, gateway courses to help with some of the low pass rates and just transitioning students from kind of the high school into the college setting. And so she had been working on a calculus redesign and a grant that she had gotten for that. And so I went to the open MAA by myself and then worked with her afterwards to kind of solidify some of the things that I had taken away from that. And it’s interesting because she did not get to teach pre calc with me when I came back because she was focused on the calculus. But one of the other faculty there, got to work with me in the fall. And then I had someone else in the spring and I will have someone else different in the fall again. So, so it’s been a little bit of spread out through the department.

Boz: So, is this a coordinated class then?

Dr. Bowman: So the short answer is no. We usually only run two sections a semester, so we, we are typically small in the sense that most of our offerings, like I said, we get one in person, one asynchronous. Every now and then we might get two in person sections and an asynchronous. So in that sense we’re not really coordinated. But we are, when one person is teaching both sections. So, So yeah, so the first semester I did this, it was, it was me and I had a TA helping out. So it was kind of coordinated. In the second semester, it was kind of coordinated in the sense that we looked at the same learning outcomes. We were using the same quizzes. We were using the same assessments, but what was done in class, like the lecturers weren’t necessarily coordinated or anything like that.

Boz: So are these other professors that you’re working with? Are they also using some form of alternative grading? Are you? Using similar grading?

Dr. Bowman: Yes. So we are using the same rubric. I will say it is not commonly graded. So we have the rubrics. It is still kind of individual interpretation of that. I would like to see us get to a place where it’s commonly graded. But we’re not there yet. And it’s just because we’re small and we’ve got too many people rotating every semester.

Boz: But that’s cool that you know, went to this MAA course really for you and one other person and then now you’ve come back and you’ve actually gotten more people than just the two of you that had originally tried to redesign it using, I love that. So I, the fact that it’s not just you came back and went to your classroom and did it, but you’re actually spreading it.

Dr. Bowman: I’ve gotten to talk with some other faculty. So there is another faculty member who hasn’t taught the pre calc, but we had conversations and he tried this in his linear algebra course. We sat down and he, shared kind of ideas on what the learning outcomes would be and kind of what to take away for an A and a B and a C and, you know, the structure on it. And he ran with that both spring and he’s going to do it again in the fall. And so I was like, that’s a big win because it’s really hard to get people on board with things. And I feel like, you know, the, the couple of conversations I had with him, he is so on board and he’s going to keep going.

Our math department and our developmental math department are not combined. And there was a faculty member in dev math who does a lot of our intermediate algebra class. And I talked with her and she tried it out in the spring. And she really enjoyed it. And so she’s going to try it in the fall again. So I feel like there’s a little side conversations happening. It’s not a big move just yet, but I feel like if I can get enough people,

Sharona: I think dev math is right for this, because the whole point of dev math for most of the students is they’ve already had the material, so giving them a structure in which they can intentionally work to build up what skills they have, I just think is amazing. What is your reassessment policy like? Are you using revisions? Are you doing reattempts? What does that look like?

Dr. Bowman: So the first two semesters, so fall and spring, we were doing, so they’d have a quiz on each learning outcome, so we would cover the material, they’d have a quiz on it. They would get it back. We would try to get it back the next class day. So our class meets five days a week. And then they would have 10 days to do a kind of a look over it, meet with the tutor, come see us, and then they could do a retake. So what we found, so I have to start this by saying I had planned to do this with the retakes and I was like, okay, this class, it’s the first time we’re reoffering it this way. It’s not a hugely popular class, even though it’s for our engineering students going into calculus. So we were thinking we’d probably have about 20 students in the class. And so I was like, between me and a TA, 20 retakes every week, probably not that bad. You know, a couple hours.

We ended up with 76 students in the course. Between me and the TA, I will say I spent more time there than I did at home and my family was not quite happy. So we, we had to rethink the retake policy on how we did it because we were having them come in and just retake it in the setting. This spring, we adjusted that a little bit. We did the retakes, we still did the retakes in the class right after we did the material. We were still doing a 10 day window but we had set, times that they could come in. So we, we tried to schedule them throughout the day. There were four set times throughout the day that you could come in and it was Monday, Wednesday, and Friday. And that seemed to work pretty well. It was still a lot of students and it was still a lot of extra time.

And so the summer. I am trying to put some of this online because we are still doing the assessments in person as well. Our department requires we have the in person assessments and written so we can’t do them online. So for us, it was a lot of class time doing the quizzes and the assessments. So this summer the classes I’m teaching, we’re doing the quizzes online. They’re timed. They’ve got the honor lock, whatever. And then the retakes are also online. So same kind of system there. And then the assessments are still proctored in person. We’re only in the second week of the summer session, but it seems to be going well, at least the quizzes so far.

Boz: Yeah, no, that is definitely one of the important lessons. Anyone that’s been doing this for a couple of semesters or anyone that’s listening needs to know is you do have to learn to utilize the tools you have available to you. Otherwise, you can end up burying yourself in an avalanche of grading. I mean, we’ve all done it. I know one of my favorite keynotes of the grading conference was still Dr. Robert Talbert when he talks about, all the different iterations he’s gone through over the years. And one of them was, you know, just buried himself in grading at the end. And so that is something that a lot of new practitioners have to end up going through. I wish you could learn from our mistakes, but it never seems to work. You have to do it.

Dr. Bowman: I will say that I’ve missed the conferences because the students definitely came in more when we were doing them in person and having the conversations with them. I still have some of those, but I feel like it was a lot more with the in person retakes. But. Yeah, definitely a lifesaver having some of these online.

Boz: And then I want to, and I know you want to jump in here, Sharona, but I also just have to point something out. The fact that you’ve done this now for a couple of semesters, you’ve stumbled, you’ve made mistakes, you’ve revised, which is exactly what we try to tell our students that this whole grading, this is why we grade the way we do so we can learn from our mistakes. But I know so many people that will get frustrated if it’s not done well the first one or two times. And like I said that, do you remember that keynote, Sharona from dr. Robert Talbert, when he talked about?

Sharona: Oh yeah,

Boz: he actually got like one of his original syllabuses out and like he couldn’t even explain it. It was.

mine from, cause I started in:

Dr. Bowman: I definitely feel I’ve tried to make that very simplified for the students, and I still feel like that is one of the biggest areas we need a little bit more work in, because Canvas is nice, it does show the learning mastery to the students, but that has been the biggest complaint I’ve gotten from them is that they can’t figure out what their grade is looking at. I’m like, yeah, I get it. So we had to create something for them to see, but then it’s making sure they have access to it and can, you know, update it and, and so forth. So that’s been fun.

Sharona: I think we’re planning, we’re planning to do an episode shortly here on on grade tracking, but what’s really interesting to me is every, it’s one of the areas that we get picked on the most by traditional grading folks is that we can’t communicate the grade. And what I have started pushing back with is. All of the current grade books are lying to the students the entire semester. Like we literally, I have a screenshot of the message that our center for effective teaching and learning puts up on canvas during the last two weeks to instructors that says, don’t forget, canvas does not treat a blank. The same as a zero. You need to go put those zeros in. And if they haven’t been keeping up on it, A student thinks they’re doing fine, and then it suddenly tanks, and I’ve had that problem.

I had a student who was not paying any attention to the grading system, and I was messaging them, and saying, hey, you’re not doing well, you’re failing, you need to start doing these things, and they’re literally emailing me back and saying, no, I’m fine. I have a 72 percent and I’m like, no, you don’t. And finally, at some point I just went and put in all the zeros for them and I dropped it down to like 22 percent because the student would not reply to me and I don’t even use the points and percentages grade book. So it’s I swear, I’m getting a little aggressive sometimes with administrators. I’m like, would you like to explain to me the standard gradebook? Because you’re not in math, so I know you don’t know how to do a weighted average.

Dr. Bowman: Well, and for us, we have a lot of reporting we have to do throughout the semester. And so it wasn’t just the students need to be able to see what their grade is. We’ve got their advisors, and then we’ve got registrar, and you know, all these places that are asking for grades. Five times during the semester. And so for, so we had to come up with something that we could do. And we actually, we found something that worked last semester. We’re tweaking it this summer. If it works.

Yay. So we’ll see.

Sharona: Now you’re talking Boz’s language. Yeah.

Dr. Bowman: It semi-worked last semester, except we still had to email updates to everybody. And so now we’ve come up with a way to do views. So as it updates, they can just log in and look and yeah, if we can get it perfected this summer, yay.

Boz: If you do, you’ll have to like show it to us afterwards, cause that’s one of the other episodes that Sharona and I have in the back burner planning is really doing a like a tool episode showcasing the great tracking, cause like she said earlier, that has been one of the pushbacks that we’ve gotten and even from people that are doing some sort of alternative grading. That’s their one thorn in their side

Sharona: So speaking of pushback What did you do to get the students to understand that they needed to do those retakes? Because it sounds like you had a pretty good uptake on those.

Dr. Bowman: So, I will say the first three that we did, we really didn’t. The first three quizzes, I think I had probably eight out of the 76 students who did the retake, where more than half of them needed it.

Sharona: Okay.

Dr. Bowman: But it was, it was I will say that first week. So we did gain some time because like I said, we used to do that big review right at the beginning of the semester. And that was like a two week review. We kind of cut that down to a day and a half. So we had some extra days. And so that first week or that’s those first three quizzes, when the students got them back in class, we spent time talking about, okay, here’s what we’re looking at. Cause we didn’t do revisions. That first week, or that first two semesters, we only did the retakes. So if they didn’t get an M, They were put into the retake category, and it was up to them. If they got the P, they were allowed to keep that P if they wanted it. But then and I guess I should mention, we were doing M, P, R, and N.

And so, if they didn’t get their P or M, we said, you know, you definitely have to take a retake because in order to pass, you can’t have any R’s or N’s, right? So you can get a D in the class, but you can’t have any R’s or N’s if you want anything higher than the D. So we spent a lot of time on those first three quizzes after we were realizing, yeah, we’re not getting people coming in taking them like they should. We spent some time in class talking about the quiz. Going over it and saying, oh, yeah, by the way, don’t forget if you didn’t get this, this is what you’re gonna need. I would say the fourth and fifth, we got a lot more students in there. Still not quite half, but, but I would say after that first couple of weeks and we got into some more of the learning outcomes, we started getting a lot more of them in. There were still a couple of students in that first semester who did not take advantage of the retakes.

And again, I think it was partly that first one. We were still figuring out how to inform them of where their grade was. So they didn’t really see, until later on. Oh my goodness, this is impacting me. I think the messaging at the start of the second semester was a lot better because we had students right away taking advantage of those retakes. And this summer, like I said, is we’re only in the second week, but I’ve already had students retaking quizzes like it. Two days after they get it back, they’re making appointments with our tutors and then coming in and trying to do the retakes. So I think part of it was just the messaging we had on our grade form, but also the messaging in the class has just been improving.

Boz: Now, I had a quick question because you said you’re doing it for the first time this summer semester. Is your summer semester a condensed semester or is it just as long as the spring and falls?

Dr. Bowman: It’s 12 weeks instead of the 16. So it’s a little bit condensed, but not super.

Boz: So I’m curious to hear how, and you might not be able to answer this cause you’re only a couple of weeks in, but how that four week condensing, what impact that has on your reassessment calendars and how you do things. Cause that’s the one thing I’ve not, and Sharona, you might have, but I have not talked to too many educators either in the high school or in the higher ed that has done this on one of those really condensed intersession or summer semesters.

Dr. Bowman: Yeah. So we, our summer they do, well, it’s 12 weeks for the full session or they’ll do two six week sessions and we flat out refuse to do any of our math classes in the six week. We just said, we’re not doing it. But for the 12 week, one of the things I did change in the syllabus was instead of the 10 day window for retakes, it’s seven. I tried not to do it any less than that. And then the other thing we changed, so I will, I didn’t mention this, but one of the other things we were doing before was we were individualizing the assessments. So, what that meant was the students maybe did the first six quizzes and we’d come to an assessment day, we’d have a form they’d fill out. They could pick which of the learning outcomes they want in their assessment. And we’d build a packet for them and they would take their assessment and every one of their assessments. They could do that.

For the summer. We’re not doing that. But that’s also cutting down some of that time. So in the summer, we’re just putting the first six outcomes on the first assessment. It’s the first 12 on the second, the next few on the third and, you know, so forth. So they’re, they’re only getting set ones and they don’t get to pick them. I don’t know how that’s going to go this summer because it’ll be the first time we’ve done it. I really liked the individual assessments because it also made the students kind of responsible for what they’re assessing on and what they still need. So we would do grade checks. Prior to them filling out an assessment packet, and it would say, Okay, you are looking at your grade sheet. Here’s what we’re seeing. You’ve got your M’s here. You’ve got P’s here. If you don’t have an M or P, you still need to assess on this, and so they would mark that off and put that in their assessment packet, and we let them pick.

So some students would pick four items, and they’re like, these are the four I want to assess on. Others would pick 10, and they’re like, these are the 10 I want to assess on. We’re like, All right. It’s up to you, but you only got an hour and you pick what you want and what you think you can assess on. And it worked pretty well because students were feeling like, Hey, I got to choose this. So I can’t blame you that I didn’t know what was right? But, but like I said, it did take a little extra time cause they had to fill out those packets. We had to put them together and then do the assessment and then grade them and all that. So that added time to it.

Sharona: Are you training the students or working with the students on how to take the first quizzes that they didn’t do well on and learn from them because that’s one thing we’re starting to see a lot of is that students don’t know how to learn from their mistakes. So how are you working with that?

Dr. Bowman: So I think the first semester with those three first quizzes that students weren’t retaking, I think we did a better job communicating some of that. I don’t know necessarily that we did such a great job the second semester, but I feel like, The students are learning to ask the, the right questions. So that first couple of quizzes so I’ll just say our first quiz is just reviewing the forms of equations because they’re going to use that point slope form, right? They need to know how to write an equation. So y intercept form and slope intercept form, we give them some points. They’ve got to come up with the equation. So it’s a, it’s review for them, but it’s an easy one to say to see where they’re making mistakes and have them look over it and talk about it because they kind of know that stuff already. They’ve seen it before in another class. And so we’ve been using that as kind of okay, here’s here’s a sample of what you’re going to see on the quiz. Here’s how it’s laid out. Here’s the outcome. Here’s how you’re going to be assessed on it. Here’s the problem work it. When you get it back, we can look through that. Hey, did you, did you actually do what this is asking in bullet number two? Or are you missing something in there? Hey, did you do what this outcome is asking or are you missing something in there?

And so we talk a little bit about that so they can kind of assess what their and then we can also look at where the mistakes are. Hey, okay so this is a small one. You went through and you changed the minus sign to a plus sign. Hey, let’s, let’s take our moment and look back over that and see if we could catch that when you, you know, review it. So it, it’s looking at it kind of both ways. And we, we did spend a little bit of time in those first couple of weeks when they’re getting those first few quizzes back, looking at that kind of thing. . The first semester, like I said, I think we did a better job of it because we were doing it more on an individual level because the students were coming in before they would do their retake. And so we were sitting down kind of one on one with the students and doing it. Whereas the second semester was more of class as a whole. Hey, let’s look at this, right? So it wasn’t as individualized the second semester, but I think, It was still okay.

Sharona: So if you had to kind of reflect on the whole year, what are the biggest takeaways for you as a faculty member from this experience? How have you changed? How have your conversations with your students changed, good, bad, either way?

Dr. Bowman: I think the first thing I would say would be to our department, and that is just making sure, I think, I honestly couldn’t have done this without the grad student help. So just realizing that we need that support in there, if, especially that first semester when we got way more students than we thought we were going to have, if I didn’t have that grad student. Yeah, I don’t know what I would have done that semester. And the second semester they gave me another grad student to work with and same thing. I think having that extra help with talking to the students and just so why do I need that grad student? So two days of the week I had the grad student in the class with me and so it was a we’re able to actually go around and work with the students a little more So having that support was super helpful. I think I You know, as I look back to that last semester I’ve definitely made changes to the syllabus. And spent more time talking about how to go through and reassess and why the reassessment is important and what the mastery means. Trying to get students away from points is really, really hard.

Boz: Well, they’ve been trained on it for, you know, probably 13 years by the time they get to you.

Dr. Bowman: Well, and in the grade book I turned off the point totals I turned off, you know, so they can look at the numbers or the, the MR PRN that they get and on like some of the automatic graded stuff that we do for daily homework. They, they still get a number, but it doesn’t add up to anything. And so we were really trying to get away from that. And we opened the learning master grade book. Well, like I said, it was so difficult for students. They were just like, what do I have? Do I have a 75 or like an 80? And I’m like, no. So I think we did, we spent, I sat down with the two grad students I had last year at the beginning of the summer and we talked about how we could restructure the grading side of things so that students could see things better.

So we made a grade progress form. We put it in the course introduction module. Students can print it out, carry it with them. And it’s check this off, you know, like you can do check marks. If you’ve got an M that’s a double check. If you’ve got a P it’s a check, but they can look at it and check it off. And like I said, it’s new this summer, cause we just finished, like playing with it so we’ll see how that goes. I have a little bit more excited about that than the learning mastery grade book in canvas. But and then other little things I would say is just having some conversations with students outside of class is still useful. I feel like that first semester, that was probably my biggest takeaway.

my asynchronous classes since:

Boz: So that brings up another question that I have then how much did your institution know about what you were doing with grading beforehand and how supportive have they been? Cause it does sound like they’ve been supported with the TAs, but did they know anything before you did it or?

Dr. Bowman: So, I will say our department is pretty good about letting us try things. I will say also that not always do we know what everybody else is doing. But I will, the other thing I will say on that is, I did talk with my department head about this and the faculty member I had done the first iteration of pre calc with that epically failed and a couple other people that just I know are open to trying new things. So out of our 13 faculty department, there’s about six of them who know what I’m doing. I mean, others probably have heard about it, but they have been kind of in the loop with everything I’ve done.

Boz: Because that’s been one of the things that it’s been a little bit surprising to me just because I only have really one experience at the higher ed and that’s at, my institution at Cal State LA. But there has been a real gambit of levels of support or resistance that a lot of the people we’ve talked to, you know, have brought up. Like we had an interview not too long ago with Dr. Rachel Weir, Weir, and like her, her Institute is incredibly supportive and then we’ve got others that we’ve talked to that, you know, the Institute has. Grading demands that go completely contradictory to alternative grading. And we have to find workarounds to still do the kind of grading we want to do without getting in trouble with the Institute.

Sharona: There are still institutions that have mandatory bell curves.

Boz: Yeah.

Sharona: Oh yeah.

Dr. Bowman: Yeah, we’ve never had that..

Sharona: Well, that’s when I start talking about things like eugenics and racism and that doesn’t go well.

Dr. Bowman: Yeah, we, I mean, we do have some things that are mandate, like I said, we are required to have paper pencil assessments. So I can’t have any assessments. Well, I mean, I can do quizzes online, but that’s different like than a test or exam and I just call them assessments because the students seem to like that better. But, and we have to do a cumulative final, which I had to ask about that because I was like, well what if my students have mastered all the outcomes I want? Do I really have to make them take that final? And they said, well, you have to give a comprehensive final. Doesn’t mean the students have to take it. So I tell them that’s their last chance. It’s got all of their outcomes. They can pick what they want to do on it. And I did, I had two students last year who showed up, put their name on it, and handed it in. It was just like, well, but, but it’s, so there’s, there’s some things like that that are mandated, but I would say we have a lot of academic freedom. As long as what we are doing is not unreasonable. So if we’re going to try anything that’s drastic, which I think changing the grading system’s kind of drastic, our department head at least needs to know about it. And she’s, she’ll be willing to say, go ahead and try it and we’ll see how it goes for a semester and reevaluate.

Sharona: Yeah, that academic freedom thing is really a two edged sword because we’ve seen so many people say, I have academic freedom. You can’t tell me I have to put active learning in the classroom. I get to just stand up and lecture from the front because that’s my academic freedom. And then on the other hand, so with those people were like, no, no, no, you shouldn’t have academic freedom to do bad pedagogy. But then we’re like, Oh, our academic freedom is to choose good grading systems. So like, suddenly it’s valuable when we think it’s valuable. So it’s, you know, I definitely was, I read something or I was listening to something recently where they were talking about, we have to be really careful with the academic freedom piece of it because there’s a content piece of it that I think most of us would defend. forever, but then is it really okay to have the academic freedom to just fail students due to poor teaching and poor pedagogy? I, you know, that’s a little bit more debatable, I think.

Boz: Then I’ve got one more question, but Sharona, if you’ve got any, I want to give you a chance to hop in cause my question’s kind of a good for the towards the end question.

Sharona: Okay. I have one more. Which is, have you gotten any feedback or noticed anything about the success of the students in the subsequent class yet? I’m thinking particularly your fall, but what are you seeing as far as, are they succeeding?

Dr. Bowman: Yes, I, I’m, I’m super excited. And this was one of the reasons I think this summer I decided, yes, I’m going to go ahead and do it. It was kind of on the fence because it was a shorter semester. I was like, eh, it’s 12 week course. But, but, i, had just gotten the data back from my fall students, so of the 76, 64 of them went on to Calculus, so C or better. There were a few, so I only had two that did not pass But the 64 that went on to some form of Calculus, 58 of them are passing with a C or better.

Sharona: Wow.

Dr. Bowman: That’s Calculus. And so for us that was huge because before what we were finding was of the students who passed, which again the pass rates were not great, I think they were like 47%. So of those students who were passing, we weren’t even seeing half of them go into Calculus. Even though that’s what this class was designed for. We have a separate 151, which is our college algebra and trig, which is 152. We have a separate course for students who aren’t taking any calculus. So that 156, which is our pre calc, is designed for those students to go in and we were seeing that less than half of the students that were passing were going in to calculus. So this time around, we’re seeing most of the students going in, And of those, the pass rates for calculus were at like 57%, I think.

Sharona: And so let me rephrase this a little bit rounding it for those non mathematicians who have a little trouble before you had less than 50 percent of the class pass, right? Of the percentage that passed, what percentage even took calculus was another less than 50 percent?

Dr. Bowman: I think it was like 28 or somewhere around 28 to 30. It was really low.

Sharona: Percent took, took calculus. Yes. And then of the 30% that took it, half of them passed it. So you’re saying your cumulative was 15%?

Dr. Bowman: Yeah. It was really bad.

Sharona: So from a student who started pre-calculus to the end of the first semester, that’s only two semesters, 15%?.

Boz: It’s less than less than 15, actually.

Dr. Bowman: Mm-Hmm.

Sharona: Less than 15.

Dr. Bowman: Yeah. It was really bad.

Sharona: So then, right. So then now of the 76, who took it you had over 90% pass.

Dr. Bowman: Yep. Mm-Hmm.

Sharona: Of the 90 plus percent who passed, just doing rough numbers in my head, you had another, so probably 80 percent of the original number went on to calculus and probably maybe 60 percent of the original actually passed. You had a four times increase, something like that.

Dr. Bowman: Yeah. I want to say it was like 62 percent passed the calculus class from our pre calc.

Sharona: So you quadrupled your throughput. So this is something that, yeah, go ahead.

Dr. Bowman: I was going to say, I will also say that it wasn’t just me. So like I mentioned before, there was a calculus instructor doing some things in her calc class. It was not the mastery grading, but they were looking at active learning and kind of changing some of the things in there. But yes, between the two of us, the pass rate had pretty much quadrupled. Okay.

Boz: In the course of one iteration that, okay. So first, Sharona, I’m never going to give you a question again, because that was my question you just stole from me. Second, that a quadruple and we’re, we’re talking about one iteration because this is your fall kids. And that is. Incredible. Like that is absolutely mind blowing. Congratulations both to you and to whoever was doing the calculus, the active learning with calculus, that, that is just. Incredible.

Dr. Bowman: I’m hoping that the spring will be the same, but I will also say we had a great group of kids in the fall, so I don’t know we’ll see what spring I’m hoping. I mean, the pass rate for the pre calc was very similar. It was a little bit lower. I want to say it was like 83 percent for spring, but that’s still a lot better than it was before. And so we’ll see what they do. Some of them are taking calculus this summer, some are waiting till the fall. So we’ll have to see at the end of the fall, how those did, but.

Sharona: Well, and it’s just interesting because we get critiqued, especially when you say things like revisions, the word revision throws certain people for a loop and they’re like, you’re reducing your rigor by giving them these multiple chances and you’re inflating your grades. And I’m like, Oh no, no, no, no, no, my requirements, my expectations for my students are sky high compared to what they used to be. The grades are still better. And the proof is in the pudding because they went into a non mastery graded class. Yes, it had gone through a redesign and all those things. And so it’s not just the grading that matters, but they can do this. They learn that they can do this. That’s incredible.

Dr. Bowman: Well, it’s the learning actual skills for learning, right? Cause that’s one of the things I’ve been telling them in these 15 minute interviews at the beginning is, you know, if you’ve never had a master graded class, this is why I’m doing it. And one of the reasons is, you know, in a traditionally graded class, I would give you an assessment in the third week. And you would take it. And if you did not do well, guess what? Your grade is tanked from the beginning, right? You’re, you’re working the rest of the semester to try and get that back up to whatever you want. And in a mastery graded class, or at least how I’ve set it up, you can tank that, but what I’m looking for is not that you look at that grade and go, Oh my God, I don’t know anything. No, I want you to look at that, figure out what you did wrong. Come see me if you can’t figure it out. But learn from that and show me that you can do it later on. And if you can do that, that’s what I want. That’s, that’s what learning is. So yeah, they, you know, and a lot of students, they don’t think of it that way until they heard that and they’re like, Oh yeah. Okay. So it’s a different system, but this is why it’s different. So, yeah.

Boz: So we only do audio, but I wish we actually were recording film or the video. When Sharona said that about the rigor, cause your reaction was hilarious and it’s the exact same thing that Sharona and I usually have. We’re like, Oh no, our rigor isn’t less.

Dr. Bowman: Oh no. Yeah. I, I definitely get in my comments every year and I’m one of the hardest people they’re always like, your class was so tough. Yes. But did you learn? And I will say I did student surveys at the end of her semester. And one of them, I am probably going to post this everywhere. And she gave me permission, but she was a student, a non traditional student hadn’t seen math in probably 15 years, which is always a red flag for me, cause I’m like, Oh no, it’s a lot of coming back. Right. And and she struggled at the beginning. And she was like, I’ve never seen mastery before. I haven’t seen math in 15 years. I don’t remember half this pre calc. So she was relearning a lot of that algebra stuff we were talking about. And halfway through, she was probably my best student. Because she was like, you know, it’s not that I don’t remember the math. I forgot how to study. And she’s like, having these retakes, having you give us feedback, and me looking at this like, oh, okay, that’s what I’m missing. Or, oh my goodness, this is a silly mistake. And having those retakes, she said, was the thing that brought her back. And she ended up the class with an A. And I. It wasn’t probably the highest at the end, but like middle of the semester, she was probably one of my best students, but she was just like, if I had to take in a traditional class after coming back, I don’t think I would have passed it. I was like, all right.

Boz: By the time that second one, that second quiz came around, you know, probably was still trying to figure out how to learn again but by that second bomb your grade can’t recover after that. So,

Sharona: I think non traditional students have the benefit of having learned how to learn in the real world. They just haven’t put the, they haven’t connected the dots that what they just spent 15 years learning in the real world about how to navigate actually is a better way to study than most of us did as undergraduates. Like if I go back now to a class, like I’d be way better at it.

Boz: Well, this has been a lot of fun, unfortunately, we are already coming up on our time. I, I just looked up at our timer and I’m like, Oh, wow. So it is, this has been a lot of fun. Are there any like last minute thoughts or comments that you wanted to make before we started signing off?

Dr. Bowman: No, I, I guess I’d say, yeah, if you’re thinking about doing this, definitely get into it. It’s worth it. I don’t think I would go back to a traditionally graded class. And I think this summer is proving it. I’m doing four summer courses and all of them are mastery based and I am

Sharona: Are they all the same prep?.

Dr. Bowman: No,but I, honestly, I feel like it’s still a lot less work now that I have them set up than it was before. And I think what I’m going to be spending my time on is more beneficial than what I was spending time on before. Because now I’m getting, I can, I feel like my feedback is better. And again, I don’t think I changed, the content didn’t change. But somehow the conversations have, and I think they’re better now than they ever were before.

Boz: That’s great. Sharona, any last minute closing thoughts?

Sharona: Just, I think by the time this one comes out, we will probably be either past the grading conference, or it might be starting in one or two days after this comes out. But I am going to encourage everyone we do record most of our sessions or all of our sessions, so within some time this summer, all the recordings will come out from the conference, so I’m going to encourage everyone to join our slack channel on the alternative grading slack. There’s links in our show notes and links on the website, and if you aren’t weren’t able to come to the conference, or you are hearing about it too late, many, many, many of those sessions are going to be recorded, as have all of our previous conferences. So it is such a great resource. So that would be my closing thought for the week. How about you, Boz?

Boz: No, just again thank you. It was great. This has been a really fun conversation. Love to do it again. You know, maybe when you get some more numbers from how this last spring’s group did, because that, that is such a huge increase. I I’m really curious to hear how that continues. So, but thanks again. Thank you for listening and we’ll see you next time.

Sharona: Please share your thoughts and comments about this episode by commenting on this episode’s page on our website, http://www.thegradingpod.Com or you can share with us publicly on Twitter, Facebook, or Instagram. If you would like to suggest a future topic for the show or would like to be considered as a potential guest for the show, please use the contact us form on our website. The Grading Podcast is created and produced by Robert Bosley and Sharona Krinsky. The full transcript of this episode is available on our website.

Boz: The views expressed here are those of the host and our guest. These views are not necessarily endorsed by the Cal State system or by the Los Angeles Unified School District.

Leave a Reply