Scaling Rectified Flow Transformers for High-Resolution Image Synthesis
Summary
The research focuses on enhancing the capabilities of rectified flow models for high-resolution image synthesis through innovative noise sampling techniques and a novel transformer-based architecture.
Key Contributions:
- Noise Scaling Improvement: The introduction of a re-weighting method for noise scales in rectified flow models, akin to noise-predictive diffusion models, significantly boosts performance over traditional approaches.
- Bidirectional Architecture: A new architecture is presented that incorporates learnable streams for both image and text tokens, enabling a two-way flow of information between them, which improves text comprehension, typography, and human preference ratings.
- Predictable Scaling Trends: The model demonstrates predictable scaling trends in validation loss, showing strong correlations with improved text-to-image synthesis assessments through quantitative metrics and human evaluations.
Core Findings:
- The novel architecture outperforms established methods like SDXL, SDXL Turbo, Pixart-α, and DALL-E 3 in both quantitative evaluations and human preference ratings.
- The research includes publicly available results, code, and model weights, contributing valuable resources to the field of text-to-image synthesis.
Methodology Highlights:
- The study compares various diffusion model formulations and rectified flow approaches systematically, identifying optimal settings through a large-scale investigation.
- The introduction of new noise samplers for rectified flow models enhances performance over existing samplers.
- The novel architecture combines with improved rectified flow formulation to explore scalability, demonstrating predictable trends in validation loss correlation with enhanced text-to-image performance.
Impact and Significance:
This work advances the state-of-the-art in high-resolution image synthesis, offering a more efficient and effective method for generating images from textual inputs, with implications for various applications requiring high-quality visual content creation.
