Diplomate Spotlight Opening Doors with Board Certification: A Conversation with Long Standing Diplomate Joseph Cook Read Opening Doors with Board Certification: A Conversation with Long Standing Diplomate Joseph Cook
Phoenix Newsletter - July 2025 Available Now: 2026 5-Year Cycle Registration Read Available Now: 2026 5-Year Cycle Registration
Home Research Research Library Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence 1999 Author(s) Veloski, J J, Rabinowitz, Howard K, Robeson, M R, and Young, P R Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, Graduate Medical Education, and Psychometrics Volume Academic Medicine Source Academic Medicine PURPOSE: To evaluate an open-ended, computer-scored testing format designed to overcome certain limitations of multiple-choice questions. METHOD: Test items covering content in family medicine were administered in two different formats to 7,036 resident physicians in 380 training programs, and to 35 experienced, board-certified physicians in conjunction with the In-training Examination of the American Board of Family Practice. Examinees completed a booklet of 40 open-ended, uncued (UnQ) test items by selecting the answer to each item from a list of over 500 responses. Similar items were administered using the standard multiple-choice question (MCQ) format. One year later, another test of 40 UnQ test items dealing with core content in family medicine was administered to 7,138 residents. RESULTS: Examinees completed over 560,000 UnQ responses with high compliance and few errors. Both reliability and validity for the UnQ format were higher than for the MCQ format, and the UnQ items discriminated more accurately among levels of physicians’ experience. The UnQ format almost eliminated the possibility that the physicians could answer questions by sight recognition or random guessing, and it was particularly effective in measuring knowledge of core content. CONCLUSIONS: This study supports the feasibility of administering open-ended test items to enhance tests of physicians’ competence. ABFM Research Read all 2014 Improving quality of care and guideline adherence for asthma through a group self-assessment module Go to Improving quality of care and guideline adherence for asthma through a group self-assessment module 2019 Practice Intentions of Family Physicians Trained in Teaching Health Centers: The Value of Community-Based Training Go to Practice Intentions of Family Physicians Trained in Teaching Health Centers: The Value of Community-Based Training 2021 Mandating Clinician COVID-19 Vaccination May Hinder Population-Level Uptake Go to Mandating Clinician COVID-19 Vaccination May Hinder Population-Level Uptake 2014 Aligning Expansion of Graduate Medical Education with Recent Recommendations for Reform. Go to Aligning Expansion of Graduate Medical Education with Recent Recommendations for Reform.
Author(s) Veloski, J J, Rabinowitz, Howard K, Robeson, M R, and Young, P R Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, Graduate Medical Education, and Psychometrics Volume Academic Medicine Source Academic Medicine
ABFM Research Read all 2014 Improving quality of care and guideline adherence for asthma through a group self-assessment module Go to Improving quality of care and guideline adherence for asthma through a group self-assessment module 2019 Practice Intentions of Family Physicians Trained in Teaching Health Centers: The Value of Community-Based Training Go to Practice Intentions of Family Physicians Trained in Teaching Health Centers: The Value of Community-Based Training 2021 Mandating Clinician COVID-19 Vaccination May Hinder Population-Level Uptake Go to Mandating Clinician COVID-19 Vaccination May Hinder Population-Level Uptake 2014 Aligning Expansion of Graduate Medical Education with Recent Recommendations for Reform. Go to Aligning Expansion of Graduate Medical Education with Recent Recommendations for Reform.
2014 Improving quality of care and guideline adherence for asthma through a group self-assessment module Go to Improving quality of care and guideline adherence for asthma through a group self-assessment module
2019 Practice Intentions of Family Physicians Trained in Teaching Health Centers: The Value of Community-Based Training Go to Practice Intentions of Family Physicians Trained in Teaching Health Centers: The Value of Community-Based Training
2021 Mandating Clinician COVID-19 Vaccination May Hinder Population-Level Uptake Go to Mandating Clinician COVID-19 Vaccination May Hinder Population-Level Uptake
2014 Aligning Expansion of Graduate Medical Education with Recent Recommendations for Reform. Go to Aligning Expansion of Graduate Medical Education with Recent Recommendations for Reform.