CodeDeploy - Multiple Simultaneous Deployments Fail


I have CodeDeploy set up with circle to deploy on the master branch with 2 build agents.

We have an error right now where if you push up to master close to the same time, codedeploy will start the deploy on one commit, then as the other deploy is still running, the code deploy step would start running on the 2nd commit and try to deploy again. However, CodeDeploy only allows 1 simultaneous deploy at a time.

This is the error that happens from codedeploy:
An error occurred (DeploymentLimitExceededException) when calling the CreateDeployment operation: Deployment Group '<depgroup>' is already deploying deployment '<deployment>'

Is there a way to queue deploys or maybe even a way to only allow 1 agent to be run concurrently on the master branch