Monday, September 12, 2022

Fair Questions

"Is the Grail A) a Cup, B) a Plate, or C) a Stone?" Dr Higgins asked in her Grail quiz to start off her lecture. I knew it was a cup and a plate, but the stone part didn't pop into my thinking. But I confidently concluded that the answer would be "all three," based on the cultural conventions of multiple-choice questions. I don't think anyone writes these down, yet we just absorb them. Someone from another culture, or someone who does not pick up cues because of OCD or spectrum wiring might not have absorbed them.

It was an informal asking, not a formal test.  It was a game with prizes, but nothing of importance was at stake. There were three choices, not four or five, and this matters. There was no hint of an added direction of "check all that apply," which also matters. Neither was it expressly denied. If it had been five choices, with one oddly possible, like "a punk-rock medieval band," or "an invented somber color" and another rather obviously humorously wrong like "a game bird" then the convention would be different. The audience would know to pick any number of answers on their best guess, whether that was expressly stated or not.

If it were a formal test like the SAT's convention would not be enough direction.  The rules would have to be spelled out. E) All of the above, and the like. Yet even in those tests there are conventions about what constitutes a fair question, and this can help you answer. They can't ask "What is the second-largest city in Vermont?" or "Are compound bows allowed in Olympic competition?" because these are niche information, not general knowledge. I was surprised that the answer to the first is South Burlington rather than Rutland, but knew that the latter is "no," which is something I happened upon years ago. 

Learning these rules, formal and informal, is also a measure of intelligence. I believe SAT prep courses give you some instruction in this, and taking this type of test a few times before might be helpful. But mostly you are supposed to learn this from your other school tests (even in homeschool curricula) or entertaining magazine quizzes or study guides or Spark Notes. You develop a feel for what will be a fair question. There are people who enjoy being difficult and smarter than everyone else who think they can defend "Well actually, France isn't really a country..." or other nonsense, and they don't do well on the tests.  They don't deserve to, even if they can hold forth on the subject. The testmakers also anticipate the OCD and spectrum people and their objections and have trimmed their questions accordingly, so that excuse doesn't hold. 

This is part of what people mean when they say "all they measure is how well you take tests" but these are common-sense understandings of the world around you, not arcane knowledge known only to the few who go to prep schools where they teach you the secret codes. If you can't figure out that they can't and won't ask you about bass players for 90s grunge bands that's on you. You have to figure out what would be general knowledge that is fair game to be asked.

7 comments:

Donna B. said...

The only 'secret' code I know is the Gomer Pyle method of decision-making. It doesn't help much on multiple choice, but I've used it a few times on ambiguous T/F questions. Ambiguous = I had no clue.

Christopher B said...

I dunno if this is Gomer's heuristic but mine is that the safest guess on a true/false statement that includes always or never is false. The exception is if you are being tested on procedural knowledge but you can usually guess by how reasonable it would be to always or never perform the action.

Mike Guenther said...

I always thought "pick Charlie" when uncertain of the answer. The odds were 60/40 in your favor.

Grim said...

So, about the Grail though? I’d like to hear more about the lecture on the Grail, if you don’t mind to share what you learned.

Assistant Village Idiot said...

I will do better than that and link to something by her if I can. She reported that there is an earlier reference than previously known by an anonymous source in a document called "Continuation One" or something sexy like that. She mostly just gave overview of what has been believed from Cretien de Troyes through Mallory and Tennyson and into the moderns, with an emphasis on Charles Williams, her specialty and Taliessen Through Logres and War in Heaven.

She is undecided whether Williams was a Christian. Tolkien said no ("witch doctor"), Lewis said yes, and she leans to "progressively more Christian as the years went, maybe by the end."

Assistant Village Idiot said...

She has a request for "a French text of the First Continuation of Chrétien de Troyes's "Perceval ou le Conte du Graal."

Grim said...

Malory often refers to 'the French book' ('as it sayeth in the French booke'), and it's unclear exactly what book he meant. It was probably a compilation -- such things were very common in those days, as all books were individually crafted rather than printed editions, and thus people would order their book to contain just what they wanted in it. I suspect it included large parts of the anonymous Prose Lancelot, but de Troyes is also likely to have been a partial inclusion.