Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

polkadot-omni-node: Fully remove benchmark sub-command #5564

Open
kianenigma opened this issue Sep 3, 2024 · 5 comments
Open

polkadot-omni-node: Fully remove benchmark sub-command #5564

kianenigma opened this issue Sep 3, 2024 · 5 comments
Assignees

Comments

@kianenigma
Copy link
Contributor

kianenigma commented Sep 3, 2024

... And make frame-omni-bencher work for all use cases, such as: #5303

Original issue for @serban300:

Remove the benchmark commands from polkadot-parachain: see comments 1, 2, 3: Here we need to wait for the CI bot bench commands to be migrated to omni-node first:

@kianenigma
Copy link
Contributor Author

kianenigma commented Sep 3, 2024

@kianenigma
Copy link
Contributor Author

@bkontur @mordamax it seems like you are taking steps towards making the omni bencher work. Can you please share how you feel about commitment and the amount of work that is left? if you need any support?

As you see in the project board, this is not super time sensitive for omni-node, but it is good to get an idea.

@mordamax
Copy link
Contributor

mordamax commented Sep 3, 2024

re #5545 i hope should be done and merged within this week

@bkontur
Copy link
Contributor

bkontur commented Sep 3, 2024

From my perspective, this is also a blocker or prerequisite: #5327 (refactoring testnet runtimes to use get_preset from the polkadot-parachain chain-specs; a few more runtimes need to be refactored). I could possibly finish it next week, or another volunteer could take it on.

After that, we need to fix frame-omni-bencher #5083. We have a hotfix/workaround here, but I think there's a bug "elsewhere," and I'd like to investigate the real cause before we merge the hotfix/workaround. I plan to look into it next week, as I'm currently focused on higher-priority tasks.

Once both are fixed/merged, we can proceed with merging #4405, which enables short benchmarks with frame-omni-bencher for CI.

After that, we can safely remove the benchmarking code from omni-node.

@skunert
Copy link
Contributor

skunert commented Sep 13, 2024

I think the latest development in this discussion was that omni-node should still expose benchmarking commands, but they should call into the same code also used by frame-omni-bencher.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Milestone 1
Development

No branches or pull requests

4 participants