Diplomate Spotlight Opening Doors with Board Certification: A Conversation with Long Standing Diplomate Joseph Cook Read Opening Doors with Board Certification: A Conversation with Long Standing Diplomate Joseph Cook
Phoenix Newsletter - July 2025 Available Now: 2026 5-Year Cycle Registration Read Available Now: 2026 5-Year Cycle Registration
Home Research Research Library Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence 1999 Author(s) Veloski, J J, Rabinowitz, Howard K, Robeson, M R, and Young, P R Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, Graduate Medical Education, and Psychometrics Volume Academic Medicine Source Academic Medicine PURPOSE: To evaluate an open-ended, computer-scored testing format designed to overcome certain limitations of multiple-choice questions. METHOD: Test items covering content in family medicine were administered in two different formats to 7,036 resident physicians in 380 training programs, and to 35 experienced, board-certified physicians in conjunction with the In-training Examination of the American Board of Family Practice. Examinees completed a booklet of 40 open-ended, uncued (UnQ) test items by selecting the answer to each item from a list of over 500 responses. Similar items were administered using the standard multiple-choice question (MCQ) format. One year later, another test of 40 UnQ test items dealing with core content in family medicine was administered to 7,138 residents. RESULTS: Examinees completed over 560,000 UnQ responses with high compliance and few errors. Both reliability and validity for the UnQ format were higher than for the MCQ format, and the UnQ items discriminated more accurately among levels of physicians’ experience. The UnQ format almost eliminated the possibility that the physicians could answer questions by sight recognition or random guessing, and it was particularly effective in measuring knowledge of core content. CONCLUSIONS: This study supports the feasibility of administering open-ended test items to enhance tests of physicians’ competence. Read More ABFM Research Read all 2023 Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019 Go to Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019 2018 A Model for Educational Survey Research Go to A Model for Educational Survey Research 2025 Changes in Family Medicine Certification Examination Performance in Longitudinal Assessment Go to Changes in Family Medicine Certification Examination Performance in Longitudinal Assessment 2015 Family Physicians with a Certificate of Added Qualifications (CAQs) in Sports Medicine Spend the Majority of Their Time Practicing Sports Medicine Go to Family Physicians with a Certificate of Added Qualifications (CAQs) in Sports Medicine Spend the Majority of Their Time Practicing Sports Medicine
Author(s) Veloski, J J, Rabinowitz, Howard K, Robeson, M R, and Young, P R Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, Graduate Medical Education, and Psychometrics Volume Academic Medicine Source Academic Medicine
ABFM Research Read all 2023 Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019 Go to Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019 2018 A Model for Educational Survey Research Go to A Model for Educational Survey Research 2025 Changes in Family Medicine Certification Examination Performance in Longitudinal Assessment Go to Changes in Family Medicine Certification Examination Performance in Longitudinal Assessment 2015 Family Physicians with a Certificate of Added Qualifications (CAQs) in Sports Medicine Spend the Majority of Their Time Practicing Sports Medicine Go to Family Physicians with a Certificate of Added Qualifications (CAQs) in Sports Medicine Spend the Majority of Their Time Practicing Sports Medicine
2023 Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019 Go to Trends of Geriatric Certification and Practice Patterns of Family Physicians: 1988-2019
2025 Changes in Family Medicine Certification Examination Performance in Longitudinal Assessment Go to Changes in Family Medicine Certification Examination Performance in Longitudinal Assessment
2015 Family Physicians with a Certificate of Added Qualifications (CAQs) in Sports Medicine Spend the Majority of Their Time Practicing Sports Medicine Go to Family Physicians with a Certificate of Added Qualifications (CAQs) in Sports Medicine Spend the Majority of Their Time Practicing Sports Medicine