How long does it take for circle to invalidate old orb cache for dev orbs?

Lets say I’m working on an orb and a project that uses the orb.
I’m making changes to the orb and publishing to dev version.
It appears that rebuilding the project doesn’t make it use the changed orb and it keeps using the old one.
Is this the expected behaviour? How can I get past this?
circleci config process returns the updated data, yet on circle it doesnt use the updated orb.