SSH timeout after port knocking

We’re using knockd to port knock and then SSH in to our server for deployment.

In the Circle CI config we’re simply running a bash script with
command: bash .circleci/
as one of the steps.

However after running the knock command and then SSH, we’re getting a timeout rather than a successful connection. To clarify, this does work from our local environments, it’s just not working from the container.

Is there an issue connecting via SSH to a different port other than 22?