Skip to content

Pull minio from docker.io/cortexproject instead of quay.io - #7864

Merged
CharlieTLe merged 1 commit into
cortexproject:masterfrom
CharlieTLe:use-cortexproject-minio
Sep 25, 2026
Merged

CharlieTLe merged 1 commit into
cortexproject:masterfrom
CharlieTLe:use-cortexproject-minio

Conversation

@CharlieTLe

Copy link
Copy Markdown
Member

Every integration leg on master and on open PRs is failing at Preload Images, before any test runs:

docker pull quay.io/minio/minio:RELEASE.2024-05-28T17-19-04Z
Error response from daemon: unauthorized: access to the requested resource is not authorized

MinIO has withdrawn its public images from quay.io, after doing the same on Docker Hub (which is why #7837 moved us to quay.io). Last green integration run was 2026-09-24 07:29 UTC; first failure 2026-09-25 04:50 UTC. No registry I could reach (quay.io, Docker Hub, mirror.gcr.io, ghcr.io, ECR Public) still serves the multi-arch RELEASE.2024-05-28T17-19-04Z image.

Change

Point the integration tests, the CI preload step and the three development docker-compose stacks at docker.io/cortexproject/minio:RELEASE.2024-07-04T14-25-45Z, an unmodified copy of MinIO's official image now hosted in the project's own Docker Hub namespace.

The docker-compose stacks used the untagged (latest) image; they are pinned to the same tag, since it is the only one we host.

Provenance of the hosted image

Copied with crane copy from an ECR Public mirror of quay.io/minio/minio, so the index is byte-identical to the source:

Index digest (source and copy) sha256:5db7e40b69f0c3ad5a878521ff5029468e3070ef146c084dc2540e2d492075c4
linux/amd64 sha256:2df94bd88de97f069f9cff76cea9751623de554800bd9ed80de147a5075b2e65
linux/arm64 sha256:429f9e43c577fc3309de27132c2005390a70b15363f9e2ea65ed5ea90e3ed6cb

Why it is MinIO's own build and not a rebuild:

  • minio --version reports commit 107d951893c3, the commit behind MinIO's GPG-verified release tag RELEASE.2024-07-04T14-25-45Z.
  • The SLSA provenance attestation (carried over in the copy) records a BuildKit build of github.com/minio/minio using Dockerfile.release at cf371da34619, MinIO's release-bot commit on top of that tag.
  • The image was created ten minutes after the tag, with MinIO's UBI9-micro base and labels.

The one check not done: comparing the binary against the checksums on dl.min.io, which was unreachable.

Version

This moves MinIO from RELEASE.2024-05-28T17-19-04Z to RELEASE.2024-07-04T14-25-45Z. The new image runs as root like the old one, so the e2e harness needs no change. Locally, against release-1.22 test code and the published v1.22.0-rc.1 image, these pass: TestGettingStartedSingleProcessConfigWithBlocksStorage, TestGettingStartedWithGossipedRing, TestIngesterSharding, TestLoadRuntimeConfigFromStorageBackend, TestQueryFrontendWithVerticalSharding. This PR's CI runs the full suite on amd64 and arm64.

This also blocks v1.22.0-rc.2: its backport PR (#7863) cannot pass integration until this is cherry-picked there.

Every integration leg is failing at Preload Images:

  docker pull quay.io/minio/minio:RELEASE.2024-05-28T17-19-04Z
  Error response from daemon: unauthorized: access to the requested
  resource is not authorized

MinIO has withdrawn its public images from quay.io, after doing the same
on Docker Hub (which is why cortexproject#7837 moved us to quay.io). No mirror still
serves the multi-arch RELEASE.2024-05-28T17-19-04Z image.

Host an unmodified copy of MinIO's official RELEASE.2024-07-04T14-25-45Z
image under docker.io/cortexproject/minio. It was copied with
`crane copy`, so its index digest,
sha256:5db7e40b69f0c3ad5a878521ff5029468e3070ef146c084dc2540e2d492075c4,
is identical to the source and it keeps linux/amd64 and linux/arm64. Its
binary reports the commit behind MinIO's signed release tag, and its
SLSA provenance records a build of github.com/minio/minio from MinIO's
own release commit.

The image runs as root like the previous one, so the e2e harness works
unchanged. The development docker-compose stacks previously pulled the
untagged (latest) image; pin them to the same tag, since that is the
only tag we host.

Signed-off-by: Charlie Le <charlie_le@apple.com>
@CharlieTLe
CharlieTLe merged commit 286e534 into cortexproject:master Sep 25, 2026
40 checks passed
CharlieTLe added a commit that referenced this pull request Sep 25, 2026
Backports to release-1.22 for v1.22.0-rc.2:

* Ingester: fix cortex_ingester_ingestion_delay_seconds losing most observations (#7858)
* Pull minio from docker.io/cortexproject instead of quay.io (#7864)

Co-authored-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: Charlie Le <charlie_le@apple.com>
CharlieTLe added a commit that referenced this pull request Sep 25, 2026
Bumps VERSION to 1.22.0-rc.2 ahead of tagging v1.22.0-rc.2.

rc.2 carries #7858 and #7864, backported in #7863.

Signed-off-by: Charlie Le <charlie_le@apple.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants