ci: move setup of download cache to default

This will enable the download cache in the package stage, which
currently spends a lot of time with downloading things.