this post was submitted on 27 Sep 2024
8 points (100.0% liked)

Stable Diffusion

4309 readers
4 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 1 year ago
MODERATORS
db0@lemmy.dbzer0.com
8
What models can we use for img2img today? (lemmy.dbzer0.com)
submitted 1 month ago by hok@lemmy.dbzer0.com to c/stable_diffusion@lemmy.dbzer0.com
1 comments fedilink hide all child comments
 

I'd like to fine tune a model that does img2img with a text prompt to guide the output. I think img2img-turbo might be the closest to what I'm after, though by default it uses a fixed prompt which can be made variable with some tweaking of the training code.

At the moment I only have access to 24GB VRAM which limits my options. What I'm after is training a model to make specific text-based modifications to images, and I have plenty of before to after images plus the modification text prompts to train on. Worst case, I can try to see if reducing the image size during training makes it possible with my setup.

Are there any other options available today?

you are viewing a single comment's thread
view the rest of the comments
[–] Even_Adder@lemmy.dbzer0.com 2 points 1 month ago

I found this guide on how to make an inpainting model out of any model. Though it's pretty out of date.