"skipMainNavigation"
closeDrawerMenuopenDrawerMenu
Search
Quick Search in Journals
Quick Search anywhere
Advanced Search
RadioGraphics
Menu
  • Information
    • Previous
    Next
    Lifelong Learning - Education Techniques for Lifelong Learning

    Writing Multiple-Choice Questions for Continuing Medical Education Activities and Self-Assessment Modules

    Published Online:Mar 1 2006https://doi.org/10.1148/rg.262055145

    Abstract

    The multiple-choice question (MCQ) is the most commonly used type of test item in radiologic graduate medical and continuing medical education examinations. Now that radiologists are participating in the maintenance of certification process, there is an increased need for self-assessment modules that include MCQs and persons with test item-writing skills to develop such modules. Although principles of effective test item writing have been documented, violations of these principles are common in medical education. Guidelines for test construction are related to development of educational objectives, defining levels of learning for each objective, and writing effective MCQs that test that learning. Educational objectives should be written in observable, behavioral terms that allow for an accurate assessment of whether the learner has achieved the objectives. Learning occurs at many levels, from simple recall to problem solving. The educational objectives and the MCQs that accompany them should target all levels of learning appropriate for the given content. Characteristics of effective MCQs can be described in terms of the overall item, the stem, and the options. Flawed MCQs interfere with accurate and meaningful interpretation of test scores and negatively affect student pass rates. Therefore, to develop reliable and valid tests, items must be constructed that are free of such flaws. The article provides an overview of established guidelines for writing effective MCQs, a discussion of writing appropriate educational objectives and MCQs that match those objectives, and a brief review of item analysis.

    © RSNA, 2006

    References

    • 1 FarleyJK. The multiple choice test: writing the questions. Nurse Educ1989;14:10–12, 39. Google Scholar
    • 2 KempJE, Morrison GR, Ross SM. Developing evaluation instruments. In: Designing effective instruction. New York, NY: MacMillan College Publishing, 1994; 180–213. Google Scholar
    • 3 GronlundNE. Assessment of student achievement. Boston, Mass: Allyn & Bacon, 1998. Google Scholar
    • 4 HaladynaTM, Downing SM, Rodriguez MC. A review of multiple-choice item-writing guidelines. Appl Meas Educ2002;15:309–333. Crossref, Google Scholar
    • 5 CaseSM, Swanson DB. Constructing written test questions for the basic and clinical sciences. Philadelphia, Pa: National Board of Medical Examiners, 1998. Google Scholar
    • 6 JozefowiczRF, Koeppen BM, Case S, Galbraith R, Swanson D, Glew H. The quality of in-house medical school examinations. Acad Med2002;77: 156–161. Crossref, Medline, Google Scholar
    • 7 American Board of Radiology. Diagnostic radiology MOC requirements. Available at: http://www.theabr.org/DR_MOC_Req.htm. Accessed January 18, 2006. Google Scholar
    • 8 Van HoozerH. The teaching process: theory and practice in nursing. Norwalk, Conn: Appleton-Century-Crofts, 1987. Google Scholar
    • 9 BraddomCL. A brief guide to writing better test questions. Am J Phys Med Rehabil1997;76:514–516. Crossref, Medline, Google Scholar
    • 10 CoxKR, Bandaranayake R. How to write good multiple choice questions. Med J Aust1978;2: 553–554. Crossref, Medline, Google Scholar
    • 11 BloomBS, ed. Taxonomy of educational objectives. Vol I: Cognitive domain. New York, NY: McKay, 1956. Google Scholar
    • 12 FuhrmannBS, Grasha AF. A practical handbook for college teachers. Boston: Little, Brown, 1983. Google Scholar
    • 13 SchultheisNM. Writing cognitive educational objectives and multiple-choice test questions. Am J Health Syst Pharm1998;55:2397–2401. Crossref, Medline, Google Scholar
    • 14 NewbleD, Cannon R. Curriculum planning. In: A handbook for teachers in universities and colleges: a guide to improving teaching methods. 3rd ed. London, England: Kogan Page, 1995. Google Scholar
    • 15 VydarenyKH, Blane CE, Calhoun JG. Guidelines for writing multiple-choice questions in radiology courses. Invest Radiol1986;21:871–876. Crossref, Medline, Google Scholar
    • 16 The National Board of Medical Examiners. Constructing written test questions for the basic and clinical sciences. Available at: http://www.nbme.org/about/itemwriting.asp. Accessed May 25, 2005. Google Scholar
    • 17 KentTH, Jones JJ, Schmeiser CB. Some rules and guidelines for writing multiple choice test items. Iowa City, Iowa: University of Iowa College of Medicine and American College Testing Program, 1974. Google Scholar
    • 18 SrinivasaDK, Adkoli BV. Multiple choice questions: how to construct and how to evaluate? Indian J Pediatr1989;56:69–74. Crossref, Medline, Google Scholar
    • 19 LowmanJ. Mastering the techniques of teaching. San Francisco, Calif: Jossey-Bass, 1984. Google Scholar
    • 20 DavisBG. Multiple-choice and matching tests. In: Tools for teaching. San Francisco, Calif: Jossey-Bass, 1993; 262–271. Google Scholar
    • 21 McKeachieWJ. Teaching tips. 8th ed. Lexington, Mass: Heath, 1986. Google Scholar
    • 22 DowningSM, Baranowski RA, Grosso LJ, Norcini JJ. Item type and cognitive ability measured: the validity evidence for multiple true-false items in medical specialty certification. Appl Meas Educ1995;8:189–199. Google Scholar
    • 23 SchuwirthLW, van der Vleuten CP. Different written assessment methods: what can be said about their strengths and weaknesses? Med Educ2004;38:974–979. Crossref, Medline, Google Scholar
    • 24 van der VleutenCP. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract1996;1:41–67. Crossref, Medline, Google Scholar

    Article History

    Published in print: Mar 2006