The American Cancer Society (ACS) guidelines define the appropriate use of MRI as an adjunct to mammography for breast cancer screening. Three risk assessment models are recommended to determine if women are at sufficient risk to warrant the use of this expensive screening tool, however, the real-world application of these models has not been explored. We sought to understand how these models behave in a community setting for women undergoing mammography screening. We conducted a retrospective analysis of 5,894 women, who received mammography screening at a community hospital and assessed their eligibility for MRI according to the ACS guidelines. Of the 5,894 women, 342 (5.8%) were eligible for MRI, but we found significant differences in the number of eligible women identified by each model. Our results indicate that these models identify very different populations, implying that the ACS guidelines deserve further development and consideration.