Diplomate Spotlight Opening Doors with Board Certification: A Conversation with Long Standing Diplomate Joseph Cook Read Opening Doors with Board Certification: A Conversation with Long Standing Diplomate Joseph Cook
Phoenix Newsletter - July 2025 Available Now: 2026 5-Year Cycle Registration Read Available Now: 2026 5-Year Cycle Registration
Home Research Research Library The reliability of ABFM examinations: implications for test-takers The reliability of ABFM examinations: implications for test-takers 2011 Author(s) Royal, Kenneth D, and Puffer, James C Topic(s) Family Medicine Certification Keyword(s) Cognitive Expertise, and Psychometrics Volume Annals of Family Medicine Source Annals of Family Medicine A common theme among family physicians that have repeatedly performed poorly on the ABFM Maintenance of Certification (MC-FP) Examination is the complaint that they received a score that was identical, or almost identical to their score on a previous administration of the exam. From their perspective, it is a mystery as to why they received the exact same score (or a very similar score), despite additional study time and preparation. Often, physicians assume a mixup has occurred and ask if it is possible that results have erroneously been provided from their previous attempt. After a psychometric review, it is clear that there is no mistake at all. In fact, we anticipate many test-takers will receive a comparable score on future attempts at successfully taking the exam. We base this anticipation on the psychometric concept of reliability. ABFM Research Read all 2025 Leveraging Large Language Models to Advance Certification, Physician Learning, and Diagnostic Excellence Go to Leveraging Large Language Models to Advance Certification, Physician Learning, and Diagnostic Excellence 2022 Measuring Graduate Medical Education Outcomes to Honor the Social Contract Go to Measuring Graduate Medical Education Outcomes to Honor the Social Contract 2022 Family Physician Racial Identity: An Analysis of “Other” Race Selection and Implications for Future Data Collection Go to Family Physician Racial Identity: An Analysis of “Other” Race Selection and Implications for Future Data Collection 2023 Academic Achievement and Competency in Rural and Urban Family Medicine Residents Go to Academic Achievement and Competency in Rural and Urban Family Medicine Residents
Author(s) Royal, Kenneth D, and Puffer, James C Topic(s) Family Medicine Certification Keyword(s) Cognitive Expertise, and Psychometrics Volume Annals of Family Medicine Source Annals of Family Medicine
ABFM Research Read all 2025 Leveraging Large Language Models to Advance Certification, Physician Learning, and Diagnostic Excellence Go to Leveraging Large Language Models to Advance Certification, Physician Learning, and Diagnostic Excellence 2022 Measuring Graduate Medical Education Outcomes to Honor the Social Contract Go to Measuring Graduate Medical Education Outcomes to Honor the Social Contract 2022 Family Physician Racial Identity: An Analysis of “Other” Race Selection and Implications for Future Data Collection Go to Family Physician Racial Identity: An Analysis of “Other” Race Selection and Implications for Future Data Collection 2023 Academic Achievement and Competency in Rural and Urban Family Medicine Residents Go to Academic Achievement and Competency in Rural and Urban Family Medicine Residents
2025 Leveraging Large Language Models to Advance Certification, Physician Learning, and Diagnostic Excellence Go to Leveraging Large Language Models to Advance Certification, Physician Learning, and Diagnostic Excellence
2022 Measuring Graduate Medical Education Outcomes to Honor the Social Contract Go to Measuring Graduate Medical Education Outcomes to Honor the Social Contract
2022 Family Physician Racial Identity: An Analysis of “Other” Race Selection and Implications for Future Data Collection Go to Family Physician Racial Identity: An Analysis of “Other” Race Selection and Implications for Future Data Collection
2023 Academic Achievement and Competency in Rural and Urban Family Medicine Residents Go to Academic Achievement and Competency in Rural and Urban Family Medicine Residents
