Elastic Beanstalk Deploymnet Breaks Wordpress URL Routing

I'm working on getting a Wordpress website running through Elastic Beanstalk. I have successfully set up the Beanstalk environment, installed Wordpress, and configured everything appropriately. The site works perfectly after the initial project upload and configuration setup. My issue arises when I try to deploy a new version of my site. When I deploy my new version, the URL routing breaks for all of the Pages I have set up.

EG I am using a static front page with a designated blog page. So mysite.com goes to the front page, and mysite.com/blog goes to the blog page. When I upload a new version of my site, mysite.com/blog bounces to the server's 404 page, not Wordpress's 404 page. If I re-setup the static front page configuration through Settings->Reading, then the routing works again.

I have no idea what's causing this. Presumably Wordpress modifies some server config file to set up the appropriate routing, and then EB overrides those changes when it deploys, but I don't know.

We've tried deploying via the command line, as well as uploading a zip file with the project and both ways cause the same problem.

Any insights here are greatly appreciated, as I've followed every tutorial I can find to a T, but none of them get around this problem. Cheers!