Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bash脚本执行时生成的视频为噪点 #173

Open
mondon11 opened this issue Jan 8, 2025 · 2 comments
Open

bash脚本执行时生成的视频为噪点 #173

mondon11 opened this issue Jan 8, 2025 · 2 comments

Comments

@mondon11
Copy link

mondon11 commented Jan 8, 2025

设置好提示词列表和seed列表后,用bash脚本跑批后生成的视频都是噪点,请问是什么原因?

#!/bin/bash

定义 prompt 列表

PROMPTS=(
"超广角仰拍,全景深,左右对称视图:清晨的海边,太阳刚刚超过海平线,海面上洒满金色的阳光.远处是连绵不断的海浪,近处海滩上有一些迎接新年的人们.油画风格,整体色调浓艳温暖."
"拉近镜头,整体色调浓艳温暖:海边日出,油画风格."
"俯瞰超广角,全景深,固定镜头,整体色调浓艳温暖,油画风格:清晨,一轮红日刚刚升起,第一缕阳光照亮长城蜒轮.背景长城砖石古朴,映着红光,点缀梅花随风飘动."
"超广角,全景深,左右对称视图:山峦起伏,河流蜿蜒,梅花点缀.远处太阳升起,象征新年的到来.传统的中国水墨画风格,整体色调浓艳温暖."
"中国山水画风格,整体色调浓艳温暖:山峦起伏,河流蜿蜒,梅花点缀.远处圆圆的红红的太阳,象征新年的到来"
)

定义种子列表

SEEDS=(201 202 203 204 205)

其他固定参数

HEIGHT=640
WIDTH=480
VIDEO_LENGTH=129
INFER_STEPS=50
SAVE_PATH="./results"
ULYSSES_DEGREE=1
RING_DEGREE=2

循环所有 prompt 和 seed 的组合

for PROMPT in "${PROMPTS[@]}"; do
for SEED in "${SEEDS[@]}"; do
echo "Running with prompt: $PROMPT and seed: $SEED"
torchrun --nproc_per_node=2 sample_video.py
--video-size $HEIGHT $WIDTH
--video-length $VIDEO_LENGTH
--infer-steps $INFER_STEPS
--prompt "$PROMPT"
--seed $SEED
--ulysses-degree $ULYSSES_DEGREE
--ring-degree $RING_DEGREE
--save-path $SAVE_PATH
done
done

@neutrino84
Copy link

neutrino84 commented Jan 8, 2025

torchrun --nproc_per_node=8 sample_video.py \
    --video-size 1280 720 \
    --video-length 129 \
    --infer-steps 50 \
    --prompt "A cat walks on the grass, realistic style." \


    --flow-reverse \  <-- you need this




    --seed 42 \
    --ulysses-degree 8 \
    --ring-degree 1 \
    --save-path ./results

@ckczzj
Copy link
Collaborator

ckczzj commented Jan 16, 2025

torchrun --nproc_per_node=8 sample_video.py
--video-size 1280 720
--video-length 129
--infer-steps 50
--prompt "A cat walks on the grass, realistic style." \

--flow-reverse \  <-- you need this




--seed 42 \
--ulysses-degree 8 \
--ring-degree 1 \
--save-path ./results

does this solve your problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants