Broader OGG support is now in development: https://developer.microsoft.com/en-us/microsoft-edge/platform/status/oggcontainer/Jay Tuckey commented
Please prioritize opus over vorbis. Opus will be used much more in the future, and people can transcode from vorbis to ogg to get support in IE.
WebM is in development – http://dev.modern.ie/platform/status/webmcontainer/Jay Tuckey commented
It is so good to see support for this being worked on! Is it too early to ask for a vague ETA? :)