I’m thinking about how I could use the benchcmp tool to run benchmarks as part of my builds, and track how the results change. My idea is to run the benchmarks on the current commit, and then
git checkout $CIRCLE_SHA1^ and run the benchmarks again.
However, what about builds with more than one commit? As I understand it,
$CIRCLE_SHA1 will give me the last commit in the build, but I really want to compare agains the parent of the first commit.
$CIRCLE_COMPARE_URL could maybe work, but I’m hoping there is a cleaner way.
I don’t even want to think about how to handle merge commits, where there are multiple parents. Maybe compare against each of them?