research Performance Evaluation of the Generative Pre-trained Transformer (GPT-4) on the Family Medicine In-Training Examination Read Performance Evaluation of the Generative Pre-trained Transformer (GPT-4) on the Family Medicine In-Training Examination
post President’s Message: ABFM’s Unwavering Commitment to Diplomates and the Specialty Read President’s Message: ABFM’s Unwavering Commitment to Diplomates and the Specialty
post “Family Medicine Was All I Ever Wanted to Do” Dr. Phillip Wagner Read “Family Medicine Was All I Ever Wanted to Do”
Home Research Research Library Examining the Functioning and Reliability of the Family Medicine Milestones Examining the Functioning and Reliability of the Family Medicine Milestones 2017 Topic(s) Education & Training BACKGROUND : The Family Medicine (FM) Milestones are a framework designed to assess development of residents in key dimensions of physician competency. Residency programs use the milestones in semiannual reviews of resident performance from entry toward graduation. OBJECTIVE : To examine the functioning and reliability of the FM Milestones and to determine whether they measure the amount of a latent trait (eg, knowledge or ability) possessed by a resident or simply indicate where a resident falls along the training sequence. METHODS : This study utilized the Rasch Partial Credit model to examine academic year 2014-2015 ratings for 10 563 residents from 476 residency programs (postgraduate year [PGY] 1 = 3639; PGY-2 = 3562; PGY-3 = 3351; PGY-4 = 11). RESULTS Reliability was exceptionally high at 0.99. Mean scores were 3.2 (SD = 1.3) for PGY-1; 5.0 (SD = 1.3) for PGY-2; 6.7 (SD = 1.2) for PGY-3; and 7.4 (SD = 1.0) for PGY-4. Keyform analysis showed a rating on 1 item was likely to be similar for all other items. CONCLUSIONS : Our findings suggest that FM Milestones seem to largely function as intended. Lack of spread in item difficulty and lack of variation in category probabilities show that FM Milestones do not measure the amount of a latent trait possessed by a resident, but rather describe where a resident falls along the training sequence. High reliability indicates residents are being rated in a stable manner as they progress through residency, and individual residents deviating from this rating structure warrant consideration by program leaders. Read More ABFM Research Read all 2013 Rural Primary Care Physician Workforce Expansion: An Opportunity for Bipartisan Legislation. Go to Rural Primary Care Physician Workforce Expansion: An Opportunity for Bipartisan Legislation. 2020 Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification Go to Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification 2017 Resident and Residency Characteristics Associated With Self-reported Preparedness for Population Health Management Go to Resident and Residency Characteristics Associated With Self-reported Preparedness for Population Health Management 2014 Tectonic shifts are needed in graduate medical education to ensure today’s trainees are prepared to practice as tomorrow’s physicians Go to Tectonic shifts are needed in graduate medical education to ensure today’s trainees are prepared to practice as tomorrow’s physicians
ABFM Research Read all 2013 Rural Primary Care Physician Workforce Expansion: An Opportunity for Bipartisan Legislation. Go to Rural Primary Care Physician Workforce Expansion: An Opportunity for Bipartisan Legislation. 2020 Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification Go to Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification 2017 Resident and Residency Characteristics Associated With Self-reported Preparedness for Population Health Management Go to Resident and Residency Characteristics Associated With Self-reported Preparedness for Population Health Management 2014 Tectonic shifts are needed in graduate medical education to ensure today’s trainees are prepared to practice as tomorrow’s physicians Go to Tectonic shifts are needed in graduate medical education to ensure today’s trainees are prepared to practice as tomorrow’s physicians
2013 Rural Primary Care Physician Workforce Expansion: An Opportunity for Bipartisan Legislation. Go to Rural Primary Care Physician Workforce Expansion: An Opportunity for Bipartisan Legislation.
2020 Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification Go to Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification
2017 Resident and Residency Characteristics Associated With Self-reported Preparedness for Population Health Management Go to Resident and Residency Characteristics Associated With Self-reported Preparedness for Population Health Management
2014 Tectonic shifts are needed in graduate medical education to ensure today’s trainees are prepared to practice as tomorrow’s physicians Go to Tectonic shifts are needed in graduate medical education to ensure today’s trainees are prepared to practice as tomorrow’s physicians