⬆️ one paper OmniPainter for the sylized T2I generation was released on arXiv

Our paper OmniPainter for the sylized text-to-image generation was released on arxiv.

Setup

Download and set up the repo:


git clone https://github.com/maxin-cn/OmniPainter
cd OmniPainter
conda env create -f environment.yml
conda activate omnipainter

Stylized image generation

You can sample high-quality images that match both the given prompt and the style reference image within just 4 to 6 timesteps, without requiring any inversion. The script has various arguments for adjusting sampling steps, changing the classifier-free guidance scale, etc:


bash run.sh

Related model weights will be downloaded automatically and following results can be obtained here.

Xin Ma
Xin Ma
PhD

My research interests include world models, video and image generation, model efficieny, and so on.

Related