Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 3DGS dataset example for Wan #290

Merged
merged 1 commit into from
Mar 4, 2025
Merged

Conversation

a-r-r-o-w
Copy link
Owner

From a small set of experiments (~10), I've found it hard to train in new concepts to the 1.3B model. It ultimately leads to model collapsing and performing bad with the lora. This is my best results so far:

output.mp4

Still not going for training the 14B variants because we need to make training significantly faster. The following are on my mind to support quickly:

  • PTD experimental context parallel
  • Flash Attention natively in diffusers (WIP)

@a-r-r-o-w
Copy link
Owner Author

Checkpoint out: https://huggingface.co/finetrainers/Wan2.1-T2V-1.3B-3dgs-v0

Some more samples:

output.mp4

@a-r-r-o-w a-r-r-o-w merged commit 17e8481 into main Mar 4, 2025
1 check passed
@a-r-r-o-w a-r-r-o-w deleted the wan/3dgs-dataset-example branch March 4, 2025 20:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant