Intelligent caching and pagination for Docker Hub releases (original) (raw)

Describe the proposed change(s).

Enhance the Docker datasource efficiency by the following:

• Similar to npm, store cached results for 24 hours by default, use them as a fallback in case we fail to look up
• Similar to GitHub platform PRs, do intelligent pagination so that we typically only need to fetch the first page of results and merge it with cached results

These changes should be specific to index.docker.io and not generic to all Docker registries. Also it should work for both the hub.docker.com as well as index.docker.io querying methods.

Describe why we need/want these change(s).

If/when Docker Hub rate limits, we want to be able to fall back to cached results for a long period of time. We also want to reduce our API requests in the first place.