Leak suggests Windows 11's taskbar or Start menu search might finally respect your default browser, such as Chrome.
To change the default browser in Outlook 365, go to File > Options > Advanced, then scroll to “Link Handling” and set “Open hyperlinks from Outlook in” to your preferred browser, like Chrome.