Like what @firstfifteensoftware said, you would be overriding the security bubble provides natively - especially if you don’t properly build it assuming you found a way to enable authentication via phone numbers.
There have been a couple of discussions in the forum about this. Here are some topics that I found which may be helpful to you.