Apr 03 2025 14 mins
DreamActor-M1 is a new framework for animating human images based on a diffusion transformer, utilizing a hybrid guidance system. This approach enables more precise control over the entire body, adapts to different image scales, and maintains consistent movement over time. The system uses a combination of facial representations, 3D head models, and body skeletons to guide motion, and it learns from diverse data featuring various resolutions and body poses. By integrating motion patterns with visual references, DreamActor-M1 generates expressive and realistic human animations, outperforming existing methods in areas like fine-grained motion, identity preservation, and temporal coherence across portrait, upper-body, and full-body scenarios.
Podcast:
https://kabir.buzzsprout.com
YouTube:
https://www.youtube.com/@kabirtechdives
Please subscribe and share.