Saturday 21 December 2013

What do "C"s and "B"s actually mean?

So here is my conundrum, and tell me if you track. The definition for "C" (grade wise) in most everything I have seen, is "Minimally meets expectations." This statement on its own makes sense. It is written in plain english.

The expectations for B.C. are very clearly laid out in the Proscribed Learning Outcomes (PLOs) and Suggested Learning Outcomes (SLOs). The PLOs make up the big picture, and the SLO fill in the finer details.

So the solution seems clear at first. If you answer some questions correctly but not others, then you get a C. And if you answer all of them correctly, you get an A. Right?

Well the answer to that varies, and is where I have an issue. The definition for a B, not A,  is "fully meets expectations". So if you get 100% on a test, you should get a B, right?

Well what does that leave for poor lonely A? It's definition is "Exceeds expectations", but if you are expected to know all the PLOs and SLOs, then how can you exceed those expectations.

This problem would likely drive me insane, if I wasn't lucky enough to have a Faculty Adviser (FA for those of you "In the know") that was pretty tuned-in to the whole assessment thing. Now I don't mean to beat a dead horse, but the solution to me seems to be Bloom's taxonomy again. The expectations are that everybody fills the bottom two rows, Knowledge and Understanding.

This scratches my itch, but it creates another more disturbing one. I received my fair share of A's in my academic career. I don't ever remember assessing, evaluating, or synthesising. Sure in English class I would write essays, but typically that was just regurgitating what the teacher had said. Essentially it was knowledge, often it wasn't even understanding, but I dotted my i's and crossed my t's and didn't dangle my participles, so I got my bright shiny A.

What do you all think? Do we give out A's too easily? Are we not challenging our students enough? Or are Tests just to see who can get a B, and the assignments and activities there to see who can reach the A level?

Monday 2 December 2013

Parable of the Parachute Packer

First, a comic from xkcd.com, because if you are anything like me, after hearing this argument, you are going to be pretty choked with your old teachers and the old way of doing things...

TornadoGuard

At First glance, this doesn't seem to have much to do with education, so let me use another example that ake the comparison a bit more obvious. I like to call it the parachute packers parable. Pretend you have 3 students. If you have taught for a while, you will probably imagine a past student when you hear their descriptions.

The Set up
Student 1 is a bit of a flake. They miss a great number of classes, but they show great potential to be a great parachute packer some day. When they try they get 100%, when they don't try they just doodle on the test. They get 50% on the final, and their average mark ends up being 50% as well

Student 2 showed great promise at the beginning of the year. They tried really hard, and received excellent grades. Unfortunately one bad mark seemed to ruin their motivation, and they checked out mentally. Their final mark ended up being zero, but their average was 50%

Student 3 struggled. In the beginning, they just didn't get it. They failed their first 3 tests, but by the 4th test they started to get it, and on their last 2 tests they did very well, and they got 100% on the final.
Their final mark was 50%




Test 1 Test 2 Test 3 Test 4 Test 5 Test 6 Final
Student 1 100 0 100 0 100 0 50
Student 2 100 100 100 50 0 0 0
Student 3 0 0 0 50 100 100 100








Here is a graph of their marks








The Choices

So all 3 students ended up with 50% in the course which, for the sake of argument, we will say is a pass. Which student would you want to pack your parachute?

 I suppose if you have a death wish, you would want student 2, who apparently forgot everything they learned about parachute packing by the time the final rolled around. Maybe they were extrinsically motivated initially by the high marks, but when that motivation wore off, they stopped trying. Or maybe the embarrassment of doing poorly was too much of a hit to their self-esteem. Either way, not my first choice for a parachute packer. 

You are going skydiving, so maybe you like to live dangerously, so maybe student 1 is your preferred packer. You have a 50/50 chance that they are on the ball that day, and by the time the final came around, they seemed to understand half of the concepts, so "YOLO" right? Do you want the student that put in the effort occasionally so that they would pass, but didn't care enough to try for the whole year?

Or, maybe you (like me) think YOLO means you should always wear a helmet, and seat belts are a must, so you want packer #3, who by the end of the course understood all of the concepts, but was punished by not understanding it at the beginning.

The Moral

We are checking for understanding, at least that is what we tell ourselves. But why does it matter if they don't understand something right away? What if it takes a while for the whole point of something to sink in? All 3 of these students received the same mark, do you think they all deserved the same mark?

Well? What do you think? Do you think they all deserved the same mark?