Beyond the Clinic Family Medicine on a Mission Part 1: How Air Force Physicians Achieve Humanitarian Goals Read Family Medicine on a Mission Part 1: How Air Force Physicians Achieve Humanitarian Goals
Phoenix Newsletter - March 2025 President’s Message: ABFM’s Unwavering Commitment to Diplomates and the Specialty Read President’s Message: ABFM’s Unwavering Commitment to Diplomates and the Specialty
Home Research Research Library Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence Patients don’t present with five choices: an alternative to multiple-choice tests in assessing physicians’ competence 1999 Author(s) Veloski, J J, Rabinowitz, Howard K, Robeson, M R, and Young, P R Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, Graduate Medical Education, and Psychometrics Volume Academic Medicine Source Academic Medicine PURPOSE: To evaluate an open-ended, computer-scored testing format designed to overcome certain limitations of multiple-choice questions. METHOD: Test items covering content in family medicine were administered in two different formats to 7,036 resident physicians in 380 training programs, and to 35 experienced, board-certified physicians in conjunction with the In-training Examination of the American Board of Family Practice. Examinees completed a booklet of 40 open-ended, uncued (UnQ) test items by selecting the answer to each item from a list of over 500 responses. Similar items were administered using the standard multiple-choice question (MCQ) format. One year later, another test of 40 UnQ test items dealing with core content in family medicine was administered to 7,138 residents. RESULTS: Examinees completed over 560,000 UnQ responses with high compliance and few errors. Both reliability and validity for the UnQ format were higher than for the MCQ format, and the UnQ items discriminated more accurately among levels of physicians’ experience. The UnQ format almost eliminated the possibility that the physicians could answer questions by sight recognition or random guessing, and it was particularly effective in measuring knowledge of core content. CONCLUSIONS: This study supports the feasibility of administering open-ended test items to enhance tests of physicians’ competence. Read More ABFM Research Read all 2021 Clinical Quality Measure Exchange is Not Easy Go to Clinical Quality Measure Exchange is Not Easy 2014 Completing Self-Assessment Modules during Residency is Associated with Better Certification Exam Results Go to Completing Self-Assessment Modules during Residency is Associated with Better Certification Exam Results 2019 A Longitudinal Study of Differences in Canadian and US Medical Student Preparation for Family Medicine Go to A Longitudinal Study of Differences in Canadian and US Medical Student Preparation for Family Medicine 2019 New Allopathic Medical Schools Train Fewer Family Physicians Than Older Ones. Go to New Allopathic Medical Schools Train Fewer Family Physicians Than Older Ones.
Author(s) Veloski, J J, Rabinowitz, Howard K, Robeson, M R, and Young, P R Topic(s) Education & Training, and Family Medicine Certification Keyword(s) Cognitive Expertise, Graduate Medical Education, and Psychometrics Volume Academic Medicine Source Academic Medicine
ABFM Research Read all 2021 Clinical Quality Measure Exchange is Not Easy Go to Clinical Quality Measure Exchange is Not Easy 2014 Completing Self-Assessment Modules during Residency is Associated with Better Certification Exam Results Go to Completing Self-Assessment Modules during Residency is Associated with Better Certification Exam Results 2019 A Longitudinal Study of Differences in Canadian and US Medical Student Preparation for Family Medicine Go to A Longitudinal Study of Differences in Canadian and US Medical Student Preparation for Family Medicine 2019 New Allopathic Medical Schools Train Fewer Family Physicians Than Older Ones. Go to New Allopathic Medical Schools Train Fewer Family Physicians Than Older Ones.
2021 Clinical Quality Measure Exchange is Not Easy Go to Clinical Quality Measure Exchange is Not Easy
2014 Completing Self-Assessment Modules during Residency is Associated with Better Certification Exam Results Go to Completing Self-Assessment Modules during Residency is Associated with Better Certification Exam Results
2019 A Longitudinal Study of Differences in Canadian and US Medical Student Preparation for Family Medicine Go to A Longitudinal Study of Differences in Canadian and US Medical Student Preparation for Family Medicine
2019 New Allopathic Medical Schools Train Fewer Family Physicians Than Older Ones. Go to New Allopathic Medical Schools Train Fewer Family Physicians Than Older Ones.