[Question] How to set the value of num_frames?

[gobigrassland]

Motivation

How to set the value of num_frames? I feel confused.

Related resources

• In Hunyuan, the number of inference video frames is set to 129.
• In preprocess_hunyuan_data.sh, when encoding the video using VAE, num_frames is set to 93.
• In finetune_hunyuan_hf_lora.sh, when fine-tuning the hunyuan model, num_frames is set to 125.

What are the differences between these num_frames values in these three contexts? What do they each represent?

[BrianChen1129]

You can set num_frames to any value in 4*n + 1 (if use sequence parallel, n needs to be divisible by gpu num)