How to reproduce the results of end-to-end throughput experiment?

[FlyFoxPlayer]

Thanks for your great work!

I want to know how to reproduce the results of end-to-end throughput experiments? That is e2e_speed. png. Can you provide the complete code integrated into FastTransformer?

Thanks！

[lswzjuer]

Since this part of the code involves the official code of FastTransformer, the open source approval process is more complicated. We will open source it within this week. Please pay attention to the update.

[lswzjuer]

hello, End-to-end test code is open source https://github.com/bytedance/ABQ-LLM?tab=readme-ov-file#e2e-benchmark

[FlyFoxPlayer]

Hello, @lswzjuer
I have seen the end-to-end experiment code, but there is an error during my replication of the experiment. It seems that the fastertransformer/src/astertransformer/models folder is missing in the current project.
Please check if there is a missing folder.
Thanks.

[lswzjuer]

hello，We are very sorry. Due to the incorrect configuration of the ignore file, we missed some folders when updating. We have now updated and completed them.