Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large memory usage when loading large state file #1917

Closed
noonio opened this issue Mar 27, 2025 · 0 comments · Fixed by #1920
Closed

Large memory usage when loading large state file #1917

noonio opened this issue Mar 27, 2025 · 0 comments · Fixed by #1920
Assignees
Milestone

Comments

@noonio
Copy link
Contributor

noonio commented Mar 27, 2025

Context & versions

It has been reported that when loading a 170gig state file, the hydra-node uses lots of memory and indeed crashes. This should not be the case since #1618 has been merged.

Steps to reproduce

  1. Create a large state file
  2. Load it
  3. Observe that memory goes up.

Actual behavior

Memory goes up.

Expected behavior

Memory usage should be bounded, even when reading from an arbitrarily-large state file.

@noonio noonio moved this from Triage 🏥 to In progress 🕐 in ☕ Hydra Team Work Mar 27, 2025
@noonio noonio added this to the 0.21.0 milestone Mar 27, 2025
@v0d1ch v0d1ch linked a pull request Mar 27, 2025 that will close this issue
4 tasks
@v0d1ch v0d1ch moved this from In progress 🕐 to In review 👀 in ☕ Hydra Team Work Mar 27, 2025
@ch1bo ch1bo linked a pull request Mar 28, 2025 that will close this issue
4 tasks
@ch1bo ch1bo self-assigned this Mar 28, 2025
@github-project-automation github-project-automation bot moved this from In review 👀 to Done ✔ in ☕ Hydra Team Work Mar 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done ✔
Status: Now
3 participants