Isn’t it funny when you post a question and immediately find the answer right after? 
Well for anyone in the future that needs a solution, all you have to do is log in to your Stripe, go to your customer portal, and change cancellation settings to end of billing period instead of cancelling immediately.
Cheers