How to Write Multiple-Choice Questions

by Sep 25, 2012Uncategorized

Not the most exciting post for my readership, perhaps, but you two could improve any teaching you do if you learned about it: multiple choice questions. My supervisor, Brad Batdorf, Ed.D., recently gave a talk on the subject and gave me permission to share with you his excellent points.

Advantages of Multiple Choice Questions

  • Multiple choice questions are versatile because they can go up and down Bloom’s taxonomy [in other words, they can be about something as important but low-level as remembering, or they can demand greater capacities for understanding, analysis, or evaluation].
  • They can range in difficulty by what wrong answers you include
  • They can achieve high “validity” (i.e., they can demonstrate whether or not students truly knew the answer and weren’t just good guessers) and reliability (as indicators of class-wide knowledge).
  • They are efficient because they can be scored quickly.

Limitations of Multiple Choice Questions

  • Multiple choice questions are limited because students can still guess (though odds are low that a pure guesser will pass).
  • They are limited because they can’t get to all kinds of knowledge.
  • They are difficult to construct—if done well.

The Anatomy of Multiple Choice Questions

The Stem

  • The stem—the “question,” as it were—should clearly present a problem.
  • It should clearly relate to a learning objective.
  • It should be stated in a positive way.
    • “All of these except…” or “Which of these is not…”—these formulations can be confusing, especially if there’s a “not” among the answers.
    • Those questions also test mainly the negative, not whether or not they know the positive answer.
  • It should not give clues for answering other questions.
  • It should not exclude info repeated in the answers.

The Alternatives (A., B., C., D., etc.)

  • Alternatives should be concise to avoid unnecessary reading time for slow readers.
  • They should be mutually exclusive.
  • They should all relate to the stem in the same kind of way.
  • Don’t make questions which reward test-savvy but instead content mastery
  • Avoid implausible alternatives (jokes, etc.).
  • Avoid keywords from the stem.
  • You can glean plausible alternatives from wrong student answers in class or on previous tests.
  • Avoid “all of the above” or “none of the above.”
    • The latter may have more usefulness.
    • “All of the above” is a guessing aid because it can be eliminated if there is one wrong answer; it can be selected automatically if there are two correct answers.
  • A “functional” distractor has positive discrimination; “non-functional” distractors are those never chosen by students.
  • Have answer appear randomly, approximately the same number of times in each position. (Teachers who aren’t random usually put the right answer in B. or C.)
  • Alternatives should not distinguish good readers from bad.
  • Analyze the effectiveness of each item.
  • Don’t word alternatives ambiguously.
  • Don’t deal only with recall (the lowest level of Bloom’s taxonomy).

 

Read More 

“The Horse Is Dead, Sir.” “Well, Beat It Some More.”

“The Horse Is Dead, Sir.” “Well, Beat It Some More.”

Faithlife just posted a blog interview they did with me about Authorized. Is there more to be said? Maybe a little! I got my first academic review of Authorized, and though I’m waiting to see if my response will be published in the same journal (the editor was...

Review: The ESV Preaching Bible

Review: The ESV Preaching Bible

The new ESV Preaching Bible is another win for Crossway. They gave me a copy to review (no strings attached, of course—well, actually, there were two ribbons in the Bible for bookmarking, but they weren’t attached to any stipulations from Crossway, just to the supple...

I’ve Got an Article in a New Book

The new Jonathan Edwards Encyclopedia has an article in it from yours truly, namely “Love.” A few friends have credits, too, including (but not limited to) Joe Tyrpak on David Brainerd (he wrote his DMin dissertation on Brainerd); Ryan Martin; and Nathan Lentfer. I...

Introduction to the New Testament for Bibles International

I wrote the following introduction to the New Testament for Bibles International; it is being translated and placed into Bibles all around the world. The Bible tells one story, because God has one plan for all of history (Isa. 46:9–10; Gal. 4:4–6). The 27 books of the...

Leave a comment.

0 Comments