Skip to main content

Danilo Díaz Granados read: This is the optimum way to compile a multiple-choice test, according to psychology research

GettyImages-880136168.jpgBy guest blogger Bradley Busch

Let’s start with a quick multiple-choice test about multiple-choice tests: when designing them, should you a) avoid using complex questions, b) have lots of potential answers for each question, c) all of the above or d) none of the above? The correct answer is (a), though as we’ll see, this was not a very well-crafted multiple-choice question. 

The issue of how best to design multiple-choice questions is important since they have been popular in both education and business settings for many years now. This is due to them being quick to administer and easy to mark and grade. Furthermore, many students often report preferring them over other test formats.

As well as being a useful assessment tool, if they are well-designed they can also aid learning. This is because of the Testing Effect – the way that retrieving knowledge helps consolidate it in memory. 

Thankfully in a recent paper in Journal of Applied Research in Memory and Cognition Andrew Butler of Washington University in St. Louis has reviewed the parallel literatures on how best to design multiple-choice tests for learning and assessment, and from this he’s recommended six evidence-based tips:  

  • Avoid using complex questions or answer formats. When things are too complex, it leads to misunderstandings and students guessing the answer. By keeping the format simple, it makes it a more reliable assessment of what the students do or don’t know. 
  • Create questions that focus on specific parts of knowledge or thought processes that you want to assess. For example, questions could focus on retrieval of a specific fact, contrasting two concepts, or applying a theory to a new situation.
  • Avoid using “None of the Above” and/or “All of the above” as potential answers. The main issue with “None of the Above” is that if it is the correct answer, then the test-taker has been exposed to numerous false answers. This therefore represents a missed opportunity to reinforce what the correct answer was. “All of the Above” may be helpful when it is the correct answer because, as Butler explains, “the test taker is only exposed to the correct information”, but may do more harm than good if it is the incorrect answer because of exposure to false answers.
  • Be economical with the number of answer options. The topic will have a bearing on the optimal number to offer, but three potential answers usually provides enough difficulty whilst also being time efficient. Excessive potential answers may be problematic if the main aim is to enhance learning, as it will “expose test takers to a lot of incorrect information, [which] is worrisome because they could potentially learn it”.
  • Ensure the answer choice is “moderately difficult”. If it is too easy or too hard then little will be learnt. Butler states that “the ideal difficulty level is a bit higher than the midpoint between chance and perfect performance”.
  • Ensure you provide feedback on the correct answers. When giving feedback to students, Butler notes that “one important caveat is that the effectiveness of feedback depends upon students being motivated to process it and their motivation tends to decrease over time”. Therefore, if feedback is delayed, it would be wise to take steps to ensure that students are “required or incentivized to process it”.

This paper has useful implications for anyone designing multiple-choice tests. Butler notes that more research is still needed, however. For example, one area that shows promise is having students assign a confidence rating to their answer, as this helps measure partial knowledge. However, the exact format for doing this is still being studied.

—Multiple-Choice Testing in Education: Are the Best Practices for Assessment Also Good for Learning?

Post written by Bradley Busch (@Inner_Drive) for the BPS Research Digest. Bradley is a registered psychologist and director of InnerDrive. He has worked with Premiership and International footballers and is the author of Release Your InnerDrive



View Source

Popular posts from this blog

Danilo Díaz Granados read: “Skunk” Cannabis Disrupts Brain Networks – But Effects Are Blocked In Other Strains

By Matthew Warren Over the past decade, neuroimaging studies have provided new insights into how psychoactive drugs alter the brain’s activity. Psilocybin – the active ingredient in magic mushrooms – has been found to reduce activity in brain regions involved in depression , for example, while MDMA seems to augment brain activity for positive memories . Now a new study sheds some light into what’s going in the brain when people smoke cannabis – and it turns out that the effects can be quite different depending on the specific strain of the drug. The research, published recently in the Journal of Psychopharmacology , suggests that cannabis disrupts particular brain networks  – but some strains can buffer against this disruption. Cannabis contains two major active ingredients: tetrahydrocannabinol (THC) and cannabidiol (CBD). THC is responsible for many of the drug’s psychoactive effects, such as the feeling of being stoned and the anxiety that people sometimes feel, as well as ...
Read more

Danilo Díaz Granados read: Beyond the invisible gorilla – inattention can also render us numb and anosmic (without smell)

By Emma Young It’s well-known that we can miss apparently obvious objects in our visual field if other events are hogging our limited attention. The same has been shown for sounds: in a nod to Daniel Simons’ and Christopher Chabris’ famous gorilla/basketball study that demonstrated “inattentional blindness”, distracted participants in the first “inattentional deafness” study failed to hear a man walking through an auditory scene for 19 seconds saying repeatedly “I am a gorilla”. Now, two new studies separately show that a very similar effect occurs in relation to touch ( inattentional numbness ) and to smell   ( inattentional anosmia ).   Sandra Murphy and Polly Dalton (a co-author on the inattentional deafness paper) at Royal Holloway, University of London report in the journal Cognition on inattentional numbness. They wanted to go beyond the way we rapidly tune out ongoing tactile stimulation, like the sensation of our clothes, and explore what happens when we’re tou...
Read more

Danilo Díaz Granados read: A New Study Has Investigated Who Watched The ISIS Beheading Videos, Why, And What Effect It Had On Them

By Emma Young In the summer of 2014, two videos were released that shocked the world. They showed the beheadings, by ISIS, of two American journalists – first, James Foley and then Steven Sotloff. Though the videos were widely discussed on TV, print and online news, most outlets did not show the full footage. However, it was not difficult to find links to the videos online. At the time, Sarah Redmond at the University of California, Irvine and her colleagues were already a year into a longitudinal study to assess psychological responses to the Boston Marathon Bombing, which happened in April 2013. They realised that they could use the same nationally representative sample of US adults to investigate what kind of person chooses to watch an ISIS beheading – and why. Their findings now appear in a paper published in American Psychologist .   By late spring 2013, the researchers had recruited 4,675 adults online, and assessed their mental health, TV-watching habits, demographics,...
Read more