The exact address is not hidden

Even though I have Hide the exact address checked, Exact address are being displayed at mennoniteyourway.com.

Please try re-setting a location for any listing, this option is applied when the location is updated (e.g. the building number is not filled in the Location field). Also, please note that this feature is available for Google Maps only, not for Mapbox yet.