Android 24: Found 1 connected device(s), 0 of which were compatible

Alright, I changed my configuration around so that I am still installing the API 24 SDK and build tools, but I am using an API 22 emulator:

dependencies:
  pre:
    - echo y | android update sdk --no-ui --all --filter android-24
    - echo y | android update sdk --no-ui --all --filter build-tools-24.0.2
test:
  override:
    - emulator -avd circleci-android22 -no-audio -no-window:
        background: true
        parallel: true
    # ...

However, now I’m running into a different error:

> Building 99% > :MyProject:connectedMyprojDebugAndroidTest:MyProject:connectedMyprojDebugAndroidTest
Tests on circleci-android22(AVD) - 5.1 failed: Instrumentation run failed due to 'java.io.FileNotFoundException'
> Building 99% > :MyProject:connectedMyprojDebugAndroidTest
com.android.builder.testing.ConnectedDevice > No tests found.[circleci-android22(AVD) - 5.1] FAILED 
> Building 99% > :MyProject:connectedMyprojDebugAndroidTestNo tests found. This usually means that your test classes are not in the form that your test runner expects (e.g. don't inherit from TestCase or lack @Test annotations).

Right now I have one “connected” test that I am able to run in my local development environment by running the same Gradle task that I’m using in my circle.yml config.

Not sure what would be causing this error. Seems like there’s something specific to my local development environment that makes it work but that CircleCI does not know about.

Any ideas of how to fix this issue?