Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

N2 Quota changes for Scale Projects #6271

Open
upodroid opened this issue Jan 12, 2024 · 4 comments
Open

N2 Quota changes for Scale Projects #6271

upodroid opened this issue Jan 12, 2024 · 4 comments
Assignees
Labels
lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. sig/scalability Categorizes an issue or PR as relevant to SIG Scalability. sig/testing Categorizes an issue or PR as relevant to SIG Testing.

Comments

@upodroid
Copy link
Member

upodroid commented Jan 12, 2024

Kubernetes project uses E2 instances on GCP by default unless we are testing something that requires specific instance types(GPU tests, scale perf testing, arm64)

k/k change: kubernetes/kubernetes#118626

With E2, the VMs issued by Google can run on modern AMD Epyc or ancient Intel Skylake hosts. However, scale job control plane nodes need to run on high-performance instances consistently and will be using N2 machine types with Ice Lake CPUs.

However, N2 quotas are not set properly and this issue will track quota failures from k8s-infra-e2e-scale-project-XX and fix them as reported.

Quotas for E2 CPUs will be bumped to 1000 in us-east1. Please ensure that jobs are running in this location

/sig testing
/sig scalability
/priority critical-urgent

@upodroid upodroid added the sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. label Jan 12, 2024
@k8s-ci-robot k8s-ci-robot added sig/testing Categorizes an issue or PR as relevant to SIG Testing. sig/scalability Categorizes an issue or PR as relevant to SIG Scalability. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. labels Jan 12, 2024
@upodroid upodroid self-assigned this Jan 12, 2024
@marseel
Copy link
Member

marseel commented Jan 12, 2024

Related failure in PR: kubernetes/perf-tests#2494
Example run: https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/perf-tests/2494/pull-perf-tests-clusterloader2/1744323040390418432
Project: k8s-presubmit-scale-36

 - Quota 'N2_CPUS' exceeded.  Limit: 24.0 in region us-east1.
	metric name = compute.googleapis.com/n2_cpus
	limit name = N2-CPUS-per-project-region
	limit = 24.0
	dimensions = region: us-east1

@upodroid
Copy link
Member Author

upodroid commented Jan 12, 2024

projects starting with k8s-* are part of the google.com org that we don't manage. Please migrate those projects to the community infrastructure.

@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 11, 2024
@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle rotten
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

@k8s-ci-robot k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels May 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. sig/scalability Categorizes an issue or PR as relevant to SIG Scalability. sig/testing Categorizes an issue or PR as relevant to SIG Testing.
Projects
None yet
Development

No branches or pull requests

4 participants