If you add this icon to the attribute’s display format, then yes, they may not be displayed because they are not available in the connected icon libraries. There are two workarounds for this:
Connect the font set where these icons are available, but note that this will require a custom implementation. Also, as an additional option, you can automatically connect the library using a third-party plugin; you can search for them on wordpress.org; there may be some.