404 Error Option Inconsistency

I want to redirect users to our external website if they encounter a 404 error on the app. There is an option that allows you to do this; however, I am experiencing an issue.

If I type in my app address, portal.ctfeval.com, I get redirected to the 404 page when the redirect to page option is enabled.

However, if the show message option is enabled and I type in the main URL I am correctly redirected to the login page. Can anyone help me correct this?

Sounds like you have page security on individual pages are redirecting to the login. If you can show a video of what you are encountering, it may help troubleshoot.

Video: https://youtu.be/xJta9Gk67gs