Hello!
This post is regarding caching gem packages downloaded via gem install (including bundler), but not Ruby itself – which is handled by rvm.
If you’re looking for a way to cache Ruby binaries themselves to speed up your build time for versions that aren’t included in our build image, head over here: Caching compiled Rubies with RVM