You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: README.md
+14-16
Original file line number
Diff line number
Diff line change
@@ -120,51 +120,49 @@ Then you can run the finetune with:
120
120
```
121
121
bash scripts/finetune/finetune_mochi.sh # for mochi
122
122
```
123
-
**Note that for finetuning, we did not tune the hyperparameters in the provided script**
123
+
**Note that for finetuning, we did not tune the hyperparameters in the provided script.**
124
124
### ⚡ Lora Finetune
125
-
Demos and prompts of Black-Myth-Wukong can be found in [here](https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight). You can download the Lora weight through:
125
+
126
+
Hunyuan supports Lora fine-tuning of videos up to 720p. Demos and prompts of Black-Myth-Wukong can be found in [here](https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight). You can download the Lora weight through:
- 30 GB GPU memory each for 2 GPUs with CPU offload and lora.
133
+
134
+
129
135
Currently, both Mochi and Hunyuan models support Lora finetuning through diffusers. To generate personalized videos from your own dataset, you'll need to follow three main steps: dataset preparation, finetuning, and inference.
130
136
131
137
#### Dataset Preparation
132
138
We provide scripts to better help you get started to train on your own characters!
133
-
You can run this to organize your dataset to get the videos2caption.json before preprocess. Specify your video folder and corresponding caption folder(Caption files should be .txt files and have the same name with its video):
139
+
You can run this to organize your dataset to get the videos2caption.json before preprocess. Specify your video folder and corresponding caption folder (caption files should be .txt files and have the same name with its video):
0 commit comments