Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: automate scale test execution #1248

Merged
merged 15 commits into from
Feb 12, 2025
Merged

Conversation

alexcastilio
Copy link
Contributor

@alexcastilio alexcastilio commented Jan 20, 2025

Description

Create automation workflow to run scale test automatically. Initially to keep it simpler, it will be executed daily with latest commit from main. In future it can be changed to run at merge if desired.
Current Scale test configuration is 1000 deployments of 20 replicas of kapinger pods running on a cluster of 1000 nodes. The cluster will be created and deleted at each automatic execution.

Changes in this PR:

  • Creation of workflow for daily execution
  • Add code to create Scale Test cluster
  • Simplify environment variables handling by doing it in params package
  • Update kapinger version
  • Update kapinger memory limit
  • Update context handling in scale test steps (improve flakiness of test)
  • Notify test job's root ctx of os signals (SIGINT and SIGTERM) to allow proper cleanup in case of interruption

Related Issue

If this pull request is related to any issue, please mention it here. Additionally, make sure that the issue is assigned to you before submitting this pull request.

Checklist

  • I have read the contributing documentation.
  • I signed and signed-off the commits (git commit -S -s ...). See this documentation on signing commits.
  • I have correctly attributed the author(s) of the code.
  • I have tested the changes locally.
  • I have followed the project's style guidelines.
  • I have updated the documentation, if necessary.
  • I have added tests, if applicable.

Screenshots (if applicable) or Testing Completed

Workflow execution was tested by triggering it on push in PR branch. Workflow: https://github.com/microsoft/retina/actions/workflows/daily-scale-test.yaml
image

Additional Notes

Add any additional notes or context about the pull request here.


Please refer to the CONTRIBUTING.md file for more information on how to contribute to this project.

@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch 3 times, most recently from 170062a to 5627ea6 Compare January 20, 2025 15:03
@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch 20 times, most recently from c997428 to 09bfdd9 Compare January 21, 2025 16:30
@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch 6 times, most recently from 4ec7d1b to f307fdc Compare January 30, 2025 15:06
@alexcastilio alexcastilio requested a review from a team as a code owner February 5, 2025 09:36
@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch from 5287d9d to 0b54abd Compare February 6, 2025 12:16
@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch 5 times, most recently from 9e0f8ae to 9af5950 Compare February 10, 2025 09:41
@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch 2 times, most recently from 015371e to 68ca12a Compare February 10, 2025 15:08
Signed-off-by: Alex Castilio dos Santos <[email protected]>
This reverts commit c05ce6f.

Signed-off-by: Alex Castilio dos Santos <[email protected]>
@alexcastilio alexcastilio force-pushed the alexcastilio/scale-test-workflow branch from 68ca12a to c56d531 Compare February 10, 2025 15:17
@alexcastilio alexcastilio added this pull request to the merge queue Feb 12, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 12, 2025
@alexcastilio alexcastilio added this pull request to the merge queue Feb 12, 2025
Merged via the queue into main with commit b6c3cc7 Feb 12, 2025
29 checks passed
@alexcastilio alexcastilio deleted the alexcastilio/scale-test-workflow branch February 12, 2025 09:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants