Thank you, this solved my problem! Changed my circleci.yml to the following
test:
override:
- RAILS_ENV=test bundle exec rspec -r rspec_junit_formatter --format RspecJunitFormatter -o $CIRCLE_TEST_REPORTS/rspec/junit.xml
Would be cool if this was included in official documentation.