Skip to content

[SPARK-56525][INFRA] Add ubuntu mirror repositories for redundancy#55389

Closed
sarutak wants to merge 4 commits intoapache:masterfrom
sarutak:add-ubuntu-mirror
Closed

[SPARK-56525][INFRA] Add ubuntu mirror repositories for redundancy#55389
sarutak wants to merge 4 commits intoapache:masterfrom
sarutak:add-ubuntu-mirror

Conversation

@sarutak
Copy link
Copy Markdown
Member

@sarutak sarutak commented Apr 17, 2026

What changes were proposed in this pull request?

This PR adds ubuntu mirror repositories to Dockerfiles for redundancy.
mirrors.edge.kernel.org seems sufficiently public and reliable.

Why are the changes needed?

For CI stability.
Sometimes, ubuntu repositories including archive.ubuntu.com and security.ubuntu.com are very slow, causing CI failures.

https://github.com/apache/spark/actions/runs/24542208092/job/71750264055
https://github.com/apache/spark/actions/runs/24544185426/job/71756248072
https://github.com/sarutak/spark/actions/runs/24552461498/job/71781474186

Does this PR introduce any user-facing change?

No.

How was this patch tested?

GA.

Was this patch authored or co-authored using generative AI tooling?

Kiro CLI / Opus 4.6.

Copy link
Copy Markdown
Member

@pan3793 pan3793 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Quite fast!

Image

@sarutak sarutak changed the title [SPARK-XXXXX][INFRA] Add ubuntu mirror repositories for redundancy [SPARK-56525][INFRA] Add ubuntu mirror repositories for redundancy Apr 17, 2026
@sarutak sarutak marked this pull request as ready for review April 17, 2026 16:54
Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use https instead of http.

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM (Pending CIs). Thank you, @sarutak and @pan3793 .

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, sorry but please revert K8s Dockerfile because it's not a part of INFRA while the PR title claims INFRA only. We can proceed that independently.

@dongjoon-hyun
Copy link
Copy Markdown
Member

Thank you for excluding that. We can proceed that independently as a [K8S] PR, @sarutak .

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM, again.

@dongjoon-hyun
Copy link
Copy Markdown
Member

Merged to master. Thank you, @sarutak and all.

dongjoon-hyun pushed a commit that referenced this pull request Apr 21, 2026
…or redundancy

### What changes were proposed in this pull request?
Similar to #55389, this PR adds ubuntu mirror repositories to K8s Dockerfiles for redundancy.
mirrors.edge.kernel.org seems sufficiently public and reliable.

### Why are the changes needed?
Sometimes, ubuntu repositories including archive.ubuntu.com and security.ubuntu.com are very slow, causing `docker build` failure.
We saw such failure on GA.
https://github.com/sarutak/spark/actions/runs/24552461498/job/71781474186

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Manually confirmed `docker build` works with modified Dockerfile.

### Was this patch authored or co-authored using generative AI tooling?
Kiro CLI / Opus 4.6

Closes #55436 from sarutak/add-ubuntu-mirror-k8s.

Authored-by: Kousuke Saruta <sarutak@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants