Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[INFRA] Disable K8s CI image GHA cache #6837

Closed
wants to merge 1 commit into from
Closed

Conversation

pan3793
Copy link
Member

@pan3793 pan3793 commented Dec 4, 2024

Why are the changes needed?

The GHA cache engine-archives seems frequently to be evicted because of exceeding the project cache capacity(10GiB), and I found the K8s IT job produces fresh large cache objects frequently, we should disable that to let engine-archives survive, to avoid downloading from the fragile archive.apache.org each time.

Connect to archive.apache.org:443 [archive.apache.org/65.108.204.189, archive.apache.org/2a01:4f9:1a:a084:0:0:0:2] failed: Network is unreachable (connect failed)
image

How was this patch tested?

Monitor GHA after merging.

Was this patch authored or co-authored using generative AI tooling?

No.

@pan3793 pan3793 requested a review from turboFei December 4, 2024 09:46
@github-actions github-actions bot added the kind:infra license, community building, project builds, asf infra related, etc. label Dec 4, 2024
@pan3793
Copy link
Member Author

pan3793 commented Dec 4, 2024

The K8s CI has room to improve, will find time to refactor it later.

@codecov-commenter
Copy link

codecov-commenter commented Dec 4, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 0.00%. Comparing base (eb1b599) to head (8bab514).
Report is 1 commits behind head on master.

Additional details and impacted files
@@          Coverage Diff           @@
##           master   #6837   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         687     687           
  Lines       42441   42441           
  Branches     5793    5793           
======================================
  Misses      42441   42441           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@pan3793 pan3793 self-assigned this Dec 4, 2024
@pan3793 pan3793 modified the milestones: v1.11.0, v1.9.4 Dec 4, 2024
@pan3793 pan3793 closed this in ea3a73f Dec 4, 2024
pan3793 added a commit that referenced this pull request Dec 4, 2024
### Why are the changes needed?

The GHA cache `engine-archives` seems frequently to be evicted because of exceeding the project cache capacity(10GiB), and I found the K8s IT job produces fresh large cache objects frequently, we should disable that to let `engine-archives` survive, to avoid downloading from the fragile `archive.apache.org` each time.

```
Connect to archive.apache.org:443 [archive.apache.org/65.108.204.189, archive.apache.org/2a01:4f9:1a:a084:0:0:0:2] failed: Network is unreachable (connect failed)
```

<img width="1306" alt="Xnip2024-12-04_17-36-03" src="https://github.com/user-attachments/assets/7e00ecad-8492-4a3e-b669-03b56a05747c">

PS: I deleted bunches of `buildkit-blob-*` manually to save `engine-archives`

### How was this patch tested?

Monitor GHA after merging.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #6837 from pan3793/k8s-it.

Closes #6837

8bab514 [Cheng Pan] [INFRA] Disable K8s CI image GHA cache

Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
(cherry picked from commit ea3a73f)
Signed-off-by: Cheng Pan <[email protected]>
pan3793 added a commit that referenced this pull request Dec 4, 2024
### Why are the changes needed?

The GHA cache `engine-archives` seems frequently to be evicted because of exceeding the project cache capacity(10GiB), and I found the K8s IT job produces fresh large cache objects frequently, we should disable that to let `engine-archives` survive, to avoid downloading from the fragile `archive.apache.org` each time.

```
Connect to archive.apache.org:443 [archive.apache.org/65.108.204.189, archive.apache.org/2a01:4f9:1a:a084:0:0:0:2] failed: Network is unreachable (connect failed)
```

<img width="1306" alt="Xnip2024-12-04_17-36-03" src="https://github.com/user-attachments/assets/7e00ecad-8492-4a3e-b669-03b56a05747c">

PS: I deleted bunches of `buildkit-blob-*` manually to save `engine-archives`

### How was this patch tested?

Monitor GHA after merging.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #6837 from pan3793/k8s-it.

Closes #6837

8bab514 [Cheng Pan] [INFRA] Disable K8s CI image GHA cache

Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
(cherry picked from commit ea3a73f)
Signed-off-by: Cheng Pan <[email protected]>
@pan3793
Copy link
Member Author

pan3793 commented Dec 4, 2024

Thanks, merged to master/1.10/1.9, I will monitor the CI in the next few days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind:infra license, community building, project builds, asf infra related, etc.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants