Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: build images for arm and amd #1138

Merged
merged 30 commits into from
Feb 12, 2025
Merged

Conversation

mikhail-sakhnov
Copy link
Contributor

@mikhail-sakhnov mikhail-sakhnov commented Nov 12, 2024

Introduce matrix strategy builds to build images for arm and amd64.
After matrix execution merge artefacts using docker manifest tool

#1089

@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch 8 times, most recently from 18968f7 to 51ab48f Compare November 13, 2024 22:36
@mikhail-sakhnov mikhail-sakhnov marked this pull request as ready for review November 14, 2024 14:24
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 51ab48f to 9d868b9 Compare November 15, 2024 17:38
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/network-settings-for-local-arm branch 2 times, most recently from 4f2e65c to 8be9777 Compare December 10, 2024 11:56
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 9d868b9 to d69b2c9 Compare December 10, 2024 11:59
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/network-settings-for-local-arm branch from 8be9777 to 9cbd3a7 Compare December 10, 2024 12:05
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from d69b2c9 to fa8268e Compare December 10, 2024 12:06
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 7c084a0 to 176974c Compare December 10, 2024 15:21
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/network-settings-for-local-arm branch 4 times, most recently from 1fd63dd to 4078a5f Compare January 27, 2025 09:46
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/network-settings-for-local-arm branch 3 times, most recently from 879a893 to 0eb0665 Compare January 31, 2025 10:07
Base automatically changed from misha/network-settings-for-local-arm to main January 31, 2025 10:32
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 176974c to a44ccce Compare February 3, 2025 11:50
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from a44ccce to c375d43 Compare February 3, 2025 12:21
Copy link
Member

@sharnoff sharnoff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, finished review of vm-kernel.yaml and remaining items :)

@sharnoff sharnoff removed their assignment Feb 10, 2025
Add comments, simplify bash script.
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 04cd285 to ec71aee Compare February 10, 2025 15:11
edude03 added a commit that referenced this pull request Feb 10, 2025
Simplifies our setup at the expense of longer image build times. Without
pushing cluster-autoscaler anywhere, it's hard to test changes from a
PR.

cc @mikhail-sakhnov re: #1138, @edude03 re: #1246

Co-authored-by: Michael Francis <[email protected]>
@mikhail-sakhnov
Copy link
Contributor Author

@sharnoff do we have anything left unreviewed here?

Copy link
Member

@sharnoff sharnoff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good!

@Omrigan Omrigan assigned mikhail-sakhnov and unassigned sharnoff Feb 11, 2025
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch 2 times, most recently from c61314c to 1293c51 Compare February 11, 2025 17:42
@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 1293c51 to 5f14280 Compare February 11, 2025 18:45
Copy link
Member

@bayandin bayandin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just noticed that GitHub doesn't allow merging the PR because it is missing the job e2e-tests (k3d).
It happened because now we have e2e-tests (k3d, amd64) and e2e-tests (k3d, arm64) jobs 🤷

I propose the following:

  • In another PR create conclusion job that depends on e2e-tests (like this)
  • Merge that PR
  • Change branch protection rules (I can do that for you)
  • Add conclusion job to this PR (or just pull the fresh main into it)

@mikhail-sakhnov mikhail-sakhnov force-pushed the misha/build-arm-images-in-ci branch from 8717280 to 852494b Compare February 12, 2025 12:10
@mikhail-sakhnov mikhail-sakhnov merged commit feea7a7 into main Feb 12, 2025
30 checks passed
@mikhail-sakhnov mikhail-sakhnov deleted the misha/build-arm-images-in-ci branch February 12, 2025 14:59
sharnoff added a commit that referenced this pull request Feb 12, 2025
A few changes here as a follow-up to #1138:

* Don't push arch-specific images to ECR; we don't have repos for them.
* Give the merge-images step an ID token to have ECR access
* Don't use IMG_* vars when pushing to ECR, because the ECR repos aren't
  prefixed with 'neondatabase/'
* Push cluster-autoscaler to ECR
* Don't push neonvm-daemon to ECR
sharnoff added a commit that referenced this pull request Feb 12, 2025
A few changes here as a follow-up to #1138:

* Don't push arch-specific images to ECR; we don't have repos for them.
* Give the merge-images step an ID token to have ECR access
* Don't use IMG_* vars when pushing to ECR, because the ECR repos aren't
  prefixed with 'neondatabase/'
* Push cluster-autoscaler to ECR
* Don't push neonvm-daemon to ECR
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants